Description:
Key Responsibilities: Data Engineering & Pipeline Development Build and maintain ETL/ELT pipelines using Azure Databricks and Microsoft Fabric.Implement medallion architecture (Bronze, Silver, Gold layers) to support data lifecycle and quality.Develop real-time and batch ingestion processes from IES Gateway and other source systems.Ensure data quality, validation, and transformation logic is consistently applied.Use Python, Spark, and SQL in Databricks and Fabric notebooks for data transformatio
Jul 16, 2025;
from:
dice.com