Numeric Data Cleaning Automation -- 2

Описание предложения

I have several datasets coming in from different systems where the numeric fields are stored as plain ASCII files in some cases and UTF-8 exports in others. My goal is to run solid, reproducible data analysis on them, but first they need to be cleaned and standardised. Here is what I need from you: • Build a repeatable cleaning pipeline in Python (Pandas, NumPy) that detects the file encoding, converts everything to UTF-8 where necessary, and validates that all numeric columns are truly numeric—no stray characters, misplaced separators, or locale-specific quirks. • Where the raw files already sit in SQL Server, create T-SQL or Python-based routines that achieve the same checks and corrections in-database so I can schedule them in an Agent job. • Document each s...

Навыки и категории

Похожие предложения