Data Engineer

Duties & Responsibilities

• Design and develop scalable data pipelines and ETL (Extract, Transform, Load) processes to collect, process, and integrate data from various sources into a centralized data warehouse or data lake.
• Implementing data models, schemas, and database structures to organize and optimize data storage for efficient data retrieval, writing and analysis.
• Collaborating with quantitative and analysts to understand their data requirements and provide them with the necessary infrastructure and tools for data exploration, analysis, and visualization.
• Ensuring data quality and consistency by implementing data validation, cleaning, and transformation procedures.
• Monitoring and maintaining the performance, availability, and security of data systems, including database servers, data warehouses, and data processing frameworks.
• Troubleshooting and resolving data-related issues and performance bottlenecks in collaboration...