Data Engineer - Consultant PySpark ADF SQL 6 months contract 2 to 4 years experience required 1[...]

Its a 6 months contract role extendable further based on client discretion.

Minimum 2 years of experience is required. Budget 10k to 12k AED. Visa. Medical Insurance. Work Permit.

What You’ll Do

• Design, develop and maintain data pipelines for ingestion, transformation, and loading of data into the data warehouse.
• Design, develop and maintain data pipelines using PySpark and Azure Data Factory (ADF).
• Implement data governance frameworks and ensure data quality, security and compliance with industry standards and regulations.
• Develop complex SQL queries and manage relational databases to ensure data accuracy and performance.
• Establish and maintain data lineage tracking within the data fabric to ensure transparency and traceability of data flows.
• Implement ETL processes to ensure the integrity and quality of data.
• Optimize data pipelines for performance, scalability and reliability.
Full-time Consulting