ETL Spark Scala Developer

Location: Montreal, QC – 3 days onsite a week

Duration: 12 Months

Face to Face Interview

We're migrating complex on-prem regulatory reporting pipelines from a legacy ETL + Autosys + SQL + Teradata stack to a modern Databricks + Snowflake platform on Azure. The role is hands‑on: design, implement, test, and reconcile production pipelines feeding regulatory reports under strict parity requirements.

Must-have

• Scala / Spark – production experience writing Spark applications in Scala (not just notebooks); comfortable with the DataFrame API, joins, window functions, partitioning, and performance tuning
• Databricks – Serverless compute, Unity Catalog, Asset Bundles, Databricks CLI
• SQL fluency – comfortable writing, analyzing and extracting requirements from complex SQL scripts
• Azure – ADLS, networking basics, secrets/identity (Entra ID / managed identities)
• Orchestration – Airf...