Senior Data Engineer

Responsibilities

• Design, develop, test, deploy, and maintain robust and scalable ELT data pipelines using dbt (data build tool) for data transformation within Snowflake.
• Orchestrate and schedule complex data workflows using Apache Airflow, ensuring timely and reliable data delivery.
• Develop connectors and scripts (primarily in Python) to extract data from various source systems (APIs, databases, files, streaming platforms) and load it into Snowflake.
• Implement data ingestion strategies (batch and streaming) using Snowflake's capabilities (e.g., Snowpipe, external stages).
• Optimize Snowflake warehouse usage, query performance, and overall data platform efficiency.
• Manage and monitor Snowflake resources, ensuring cost-effectiveness and scalability.
• Implement and enforce data governance, security (e.g., RBAC, data masking), and privacy best practices within Snowflake.
• Assist in schema design, table optimiza...