Opportunity Description
Job Description
We are seeking a highly experienced Azure Data Engineer with 10+ years of hands-on experience, specializing in Azure Data Factory and Azure Databricks, to design, build, and manage scalable, secure, and high-performance data platforms on Microsoft Azure.
The ideal candidate will be deeply skilled in ETL/ELT engineering, distributed data processing, and cloud-native data architecture, and will play a key role in transforming complex data from multiple sources into reliable, analytics ready datasets that support business and operational decision-making.
Key Responsibilities
- Design, develop, and maintain robust ETL/ELT pipelines using Azure Data Factory and Azure Databricks.
- Ingest and integrate data from on-premises systems, cloud platforms, APIs, and flat files into Azure-based data platforms.
- Build and optimize data processing frameworks using Databricks (PySpark / Spark SQL) for large-scale data transf...