Data engineer

Job Reference: GTG -KV-1 Responsible for maintaining the data warehouse through design and implementation of ETL/ELT methodologies and technologies, as well as providing maintenance and support to our ETL and ML environments. To ensure optimal performance, the candidate will conduct root cause analysis on production issues and provide technical leadership throughout the entire information management process of both structured and unstructured data. Duties & Responsibilities Duties: Responsible for solution design and development of various functionalities in AWS for the project flow. Develop and maintain automated ETL pipelines (with monitoring) using scripting languages such as Python, SQL, and AWS services such as S3, Glue, Lambda, SNS, Redshift, SQS, KMS. Develop Glue Jobs for batch data processing and create Glue Catalog for metadata synchronization. Develop data pipelines using AWS Lambda and Step Functions for data processing. Manage data coming from different sources. Experience...