Key Responsibilities:

Design and implement Hadoop workflows and data pipelines to support our data analytics initiatives
Develop and maintain ETL processes to extract, transform, and load data from various sources into our Hadoop cluster
Work closely with data analysts and data scientists to understand their data requirements and design solutions to meet their needs
Monitor the health and performance of our Hadoop cluster and troubleshoot any issues that arise
Optimize the performance of our Hadoop cluster by tuning parameters, implementing best practices, and leveraging new technologies
Participate in code reviews, testing, and debugging to ensure the quality and reliability of our Hadoop applications
Keep up-to-date with the latest developments in the Hadoop ecosystem and make recommendations for the adoption of new technologies and tools
Collaborate with cross-functional teams to integrate our Hadoop cluster with other systems and applications
Document and maintain technical specifications, process flows, and system diagrams for our Hadoop applications
Mentor and provide technical guidance to junior developers on the team

Qualifications:

Bachelor's degree in Computer Science, Engineering, or a related field
Minimum of 3 years of experience working with Hadoop and its related technologies (Hive, Pig, Spark, etc.)
Strong understanding of Hadoop architecture, components, and ecosystem
Experience designing and developing Hadoop workflows, data pipelines, and ETL processes
Proficient in programming languages such as Java, Scala, or Python
Experience with SQL and NoSQL databases
Familiarity with data warehousing concepts and tools
Experience with data visualization tools such as Tableau or Power BI is a plus
Strong problem-solving and analytical skills
Excellent communication and teamwork abilities
Proven ability to work in a fast-paced, dynamic environment

Join our team and be a part of our exciting journey to drive innovation and deliver cutting-edge solutions to our clients.

Hashtags