Data Engineer

• Relevant 3-year tertiary qualification BSC In Computer Science / Information Systems

In depth knowledge and understanding:

• Data governance and data management frameworks
• BI and Warehouse design
• Movement of data into the Cloud using the following tools Apache Kafka, Storm, Flume for ingesting data or Amazon Web Services (AWS) Cloud Development Kit (CDK)
• Operating with real-time streams, data warehouse queries, JSON, CSV, raw data
• Scripting Data Pipelines for scheduled movement of data
• Designing and developing ETL/ELT processes and data pipelines Experience working with Azure DevOps
• Exploratory Data Analysis - EDA
• SQL
• Microsoft SQL Server
• NoSQL
• Microsoft SQL Server
• Python (PySpark)
• C#, Json- calling APIs
• PowerShell
• Kafka
• Scala
• Splunk
• Elk Stack
• Data warehousing solutions
• Data ...