Key Responsibilities:

Design, develop and maintain our Mapreduce platform to process large-scale data sets
Work closely with data scientists, software engineers, and other team members to understand project requirements and translate them into technical solutions
Troubleshoot and debug issues with the Mapreduce platform, ensuring timely resolution to minimize impact on data processing
Optimize Mapreduce jobs for performance and scalability
Collaborate with cross-functional teams to identify and implement new features and enhancements to the Mapreduce platform
Monitor and maintain the health and stability of the Mapreduce platform, ensuring high availability and reliability
Stay up-to-date with the latest advancements and trends in Mapreduce and other big data technologies, and recommend improvements to our platform

Qualifications:

Bachelor's or Master's degree in Computer Science, Mathematics, or related field
Minimum of 3 years of experience in Mapreduce development and maintenance
Strong proficiency in Java and Python
Experience with big data technologies such as Hadoop, Spark, and Kafka
Solid understanding of distributed computing principles and algorithms
Familiarity with database management systems and SQL
Ability to write efficient and optimized Mapreduce jobs
Excellent problem-solving and analytical skills
Strong communication and collaboration skills
Ability to work in a fast-paced and dynamic environment

Hashtags