Opportunity Description
Data Engineer
Washington DC (Day1 onsite)
Key Responsibilities
Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark
Implement complex data transformations using Spark SQL and Python (mandatory)
Build and manage analytics models using DBT Core / DBT Cloud, following analytics engineering best practices
Develop and orchestrate data ingestion and transformation workflows using Azure Data Factory
Ensure data quality, reliability, and performance across batch and near real time pipelines
Integrate Databricks workloads with downstream reporting, analytics, and AI/ML use cases
Collaborate with cross functional teams to understand business requirements and translate them into technical solutions
Implement CI/CD pipelines and source control using Azure DevOps
Apply secure data engineering practices aligned with WBG data governance and compliance standards
Leve...
Washington DC (Day1 onsite)
Key Responsibilities
Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark
Implement complex data transformations using Spark SQL and Python (mandatory)
Build and manage analytics models using DBT Core / DBT Cloud, following analytics engineering best practices
Develop and orchestrate data ingestion and transformation workflows using Azure Data Factory
Ensure data quality, reliability, and performance across batch and near real time pipelines
Integrate Databricks workloads with downstream reporting, analytics, and AI/ML use cases
Collaborate with cross functional teams to understand business requirements and translate them into technical solutions
Implement CI/CD pipelines and source control using Azure DevOps
Apply secure data engineering practices aligned with WBG data governance and compliance standards
Leve...