Microsoft Fabric Lakehouse Integration

Offer description

Microsoft Fabric / PySpark Data Engineer Needed We need an experienced Microsoft Fabric and PySpark freelancer to work with our backend team on modernizing a high-volume SQL-based data processing platform. Currently, large raw datasets are loaded into SQL Server and processed through multiple stored procedures for data quality, validation, transformations, and business rules. We want to move the heavy data-processing components to Fabric Lakehouse + Delta + Spark/PySpark, while keeping appropriate workloads in SQL/Fabric Warehouse. You should be able to: Build Fabric Lakehouse/OneLake architecture Develop Spark/PySpark transformations Work with Delta tables Build/modify Fabric or ADF pipelines Convert suitable SQL stored-procedure workloads to Spark Implement incremental/batch processi...

Skills and categories

Similar offers