Data Engineer

Mandatory Skills (Must‑Have) Azure Data Factory (ADF) – metadata‑driven pipelines Basic Cloudera working knowledge Cloudera → Cloud migration (mandatory) Large‑volume historical data migration Azure Databricks (Spark / SQL) Data reconciliation and audit sign‑off Framework‑based data ingestion / migration
Good‑to‑Have Azure Data Box–based migration experience Bulk history extraction using Data Box Landing data into ADLS Gen2 Processing history in Databricks (Delta) Orchestrating incrementals via ADF