Opportunity Description
Key Duties and Responsibilities
Build & Scale Data Systems
Build & Scale Data Systems
- Architect and deliver large-scale data migration strategies for identity transformation
- Build robust batch and streaming pipelines using Apache Spark
- Develop data lineage, validation, and reconciliation frameworks to ensure data integrity
- Orchestrate highly parallel data workflows for performance and reliability
- Lead upgrades and optimisation of Spark and JVM environments in production
- Implement monitoring and observability to ensure system health and performance
- Design test frameworks to validate complex migration scenarios
- Take ownership of critical components and drive engineering excellence
- Mentor team members through pair programming, reviews, and coaching
- Lead technical discussions and influence architecture decisions
- Proactively identify risks and remove del...
Ready to Apply?
Submit your application for Senior Data Engineering Technical Lead at Network Recruitment
Apply for this Position