Hadoop Developer

Lobox is an equal opportunity employer. We value diversity and are committed to creating an inclusive workplace for all employees.

Job Title: Hadoop Developer

Location: San Francisco, California, United States

Company: Lobox

Employment Type: Contract

Salary: $100 Per hour

Job Description: We are seeking a highly skilled Hadoop Developer to join our dynamic team. As a Hadoop Developer, you will be responsible for designing, developing, and maintaining our Hadoop-based applications and infrastructure. You will work closely with our data scientists and analysts to ensure the smooth functioning of our big data ecosystem.

Key Responsibilities:

• Design, develop, and maintain Hadoop-based applications and infrastructure
• Create and maintain scalable and high-performance data processing pipelines
• Write efficient and optimized MapReduce jobs, Hive queries, and Pig scripts
• Monitor and troubleshoot Hadoop cluster performance and capacity
• Collaborate with data scientists and analysts to understand their requirements and translate them into technical solutions
• Implement security and data privacy measures in the Hadoop ecosystem
• Maintain and enhance data quality and data governance processes
• Conduct code reviews and provide technical guidance to junior developers
• Stay updated with the latest developments in the Hadoop ecosystem and recommend new tools and technologies to improve our data processing capabilities

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field
• Minimum of 3 years of experience working with Hadoop and its ecosystem tools such as MapReduce, Hive, Pig, Spark, etc.
• Strong understanding of Hadoop architecture and distributed systems
• Experience with Hadoop cluster management and performance tuning
• Proficient in programming languages such as Java, Python, or Scala
• Experience with SQL and database management systems
• Knowledge of ETL processes and data warehousing concepts
• Experience with data integration tools such as Informatica, Talend, or Pentaho
• Excellent problem-solving and analytical skills
• Good communication and interpersonal skills
• Ability to work independently as well as in a team environment
• Familiarity with Agile software development methodologies is a plus
• Hadoop certifications are highly preferred

We offer a competitive salary package, a collaborative work environment, and opportunities for growth and career development. If you are passionate about big data and have the skills and experience we are looking for, we would love to hear from you. Apply now and become a part of our team of talented Hadoop Developers!