Senior Software Consultant - Hadoop EBP

Responsibilities

The Hadoop EBP Engineer is responsible for designing, developing, and managing large-scale data processing systems using Hadoop and related big data technologies. The role focuses on building and maintaining enterprise-grade data platforms that support analytics, reporting, and data-driven decision-making.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Hadoop ecosystem tools.
• Manage and optimize Hadoop clusters (HDFS, YARN, MapReduce) in enterprise environments.
• Develop ETL workflows to ingest, process, and transform large datasets.
• Work with tools such as Hive, Spark, Sqoop, Kafka, and HBase for data processing.
• Ensure data reliability, availability, and security across the platform.
• Monitor and troubleshoot performance issues in big data systems.
• Collaborate with data scientists, analysts, and business st...