Hadoop Developer

Joining our team as a Hadoop Developer will provide you with the opportunity to work on cutting-edge technologies and projects

Job Title: Hadoop Developer

Location: San Francisco, California, United States

Salary: $171000 - $208000

Position Overview: We are looking for a skilled Hadoop Developer to join our dynamic team. As a Hadoop Developer, you will be responsible for designing and developing efficient and scalable solutions using Hadoop technologies. You will work closely with our data scientists, analysts, and other developers to build and maintain our data infrastructure. The ideal candidate will have a strong background in Hadoop, data warehousing, and programming languages such as Java or Python.

Key Responsibilities:

• Design and develop Hadoop-based applications to process large volumes of data
• Develop and maintain data pipelines and ETL processes
• Troubleshoot and resolve issues related to data processing, storage, and retrieval
• Collaborate with cross-functional teams to design and implement data solutions
• Optimize Hadoop cluster performance and capacity planning
• Develop and maintain data architecture and data models
• Write and optimize complex SQL queries to support data analysis and reporting
• Monitor and troubleshoot data quality and consistency issues
• Stay updated with the latest trends and advancements in Hadoop and big data technologies
• Participate in code reviews and provide constructive feedback to improve code quality and performance
• Document technical specifications, processes, and procedures

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• Minimum of 3 years of experience in developing Hadoop-based solutions
• Strong understanding of Hadoop architecture and core concepts such as HDFS, MapReduce, YARN, and Hive
• Hands-on experience with Hadoop ecosystem tools such as Spark, Pig, and Kafka
• Proficient in at least one programming language such as Java, Python, or Scala
• Experience with data warehousing and data modeling concepts
• Knowledge of SQL and database concepts
• Excellent problem-solving and analytical skills
• Ability to work in a fast-paced and dynamic environment
• Strong attention to detail and ability to deliver high-quality work
• Good communication and interpersonal skills

Preferred Qualifications:

• Experience with cloud-based Hadoop solutions such as AWS EMR or Google Dataproc
• Familiarity with Agile methodologies and working in a scrum team
• Experience with data visualization tools such as Tableau or Power BI
• Knowledge of machine learning and data science concepts
• Certifications in Hadoop or related technologies

You will have the chance to collaborate with a talented and diverse team and make a significant impact on our data infrastructure. If you are passionate about big data, have a strong technical background, and are looking for a challenging role, we would love to hear from you. Apply now and take the next step in your career as a Hadoop Developer.