Opportunity Description
Key Responsibilities
- Architect and build scalable data platforms using Azure (ADF, Databricks, Data Lake, Synapse)
- Design and optimize ETL/ELT pipelines for large-scale data processing
- Develop distributed data solutions using PySpark and Python
- Ensure performance, cost optimization, data quality, and security
- Define data architecture standards, governance, and best practices
- Implement CI/CD and DevOps for data workflows
- Lead troubleshooting, performance tuning, and cloud migration initiatives
- Collaborate with stakeholders and mentor junior engineers
Required Skills
- Strong experience in Azure data services (ADF, Databricks, Synapse, Data Lake, Azure SQL)
- Expertise in PySpark, Python, and advanced SQL
- Solid understanding of ETL/ELT, data warehousing, and lakehouse architecture
- Experience with DevOps, CI/CD, and Git
- Knowledge o...