Hadoop Developer

Join us and be a part of our mission to help businesses make data-driven decisions and achieve success

Job Title: Hadoop Developer

Location: San Francisco, California, United States

Salary: $171000 - $208000

Company Overview: We are a leading data analytics company that specializes in providing cutting-edge solutions to businesses across various industries. Our team is composed of highly skilled professionals who are passionate about using data to drive business decisions and achieve success. As we continue to grow, we are looking for a talented Hadoop Developer to join our team and help us deliver innovative solutions to our clients.

Job Overview: As a Hadoop Developer, you will be responsible for designing, developing, and maintaining our Hadoop-based data platforms. You will work closely with our team of data scientists and engineers to implement data solutions that meet our clients' needs. Your role will involve writing complex MapReduce jobs, developing ETL processes, and optimizing Hadoop cluster performance. You will also be responsible for troubleshooting any issues that arise and providing support to our clients as needed.

Key Responsibilities:

• Design and develop Hadoop-based data platforms and solutions to meet business requirements
• Write complex MapReduce jobs to process large datasets
• Design and implement ETL processes to extract, transform, and load data into Hadoop
• Optimize cluster performance by tuning Hadoop configurations and implementing best practices
• Troubleshoot and resolve any issues related to Hadoop cluster performance, data quality, or system failures
• Collaborate with data scientists and engineers to integrate data from various sources into Hadoop
• Ensure data security and compliance with industry standards
• Keep up-to-date with the latest Hadoop technologies and trends and make recommendations for improvements to our platform
• Provide support to clients and end-users as needed

Qualifications:

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field
• Minimum of 3 years of experience as a Hadoop Developer or in a similar role
• Strong knowledge of Hadoop ecosystem components such as HDFS, MapReduce, Hive, Pig, Sqoop, and Spark
• Experience with ETL tools and processes, data warehousing, and data modeling
• Proficient in programming languages such as Java, Python, and Scala
• Good understanding of Linux/Unix operating systems and shell scripting
• Experience with cloud platforms such as AWS, Azure, or Google Cloud is a plus
• Strong problem-solving and analytical skills
• Excellent communication and teamwork abilities

We offer a competitive salary, benefits package, and a collaborative work environment with opportunities for growth and career development. If you are a self-motivated individual with a passion for data and a desire to constantly learn and improve, we would love to have you on our team.

Apply now and take the next step in your career as a Hadoop Developer.