If you are a highly motivated and results-driven individual with a passion for big data and Hadoop, we want to hear from you! Join our team and be a part of our exciting journey towards innovation and success
Job Title: Hadoop Developer
Location: San Francisco, California, United States
Salary: $171000 - $208000
We are seeking a talented Hadoop Developer to join our dynamic and innovative team. As a Hadoop Developer, you will be responsible for designing, developing, and maintaining our Hadoop-based applications. You will have the opportunity to work on cutting-edge projects and collaborate with cross-functional teams to deliver high-quality solutions.
Key Responsibilities:
- Designing, developing and maintaining Hadoop-based applications.
- Developing and implementing complex ETL processes to transform data from various sources into Hadoop.
- Writing efficient MapReduce jobs to process large datasets.
- Troubleshooting and resolving issues with Hadoop clusters.
- Optimizing Hadoop cluster performance and capacity planning.
- Creating and managing data pipelines to ensure smooth data flow.
- Developing and maintaining data governance and security policies.
- Collaborating with cross-functional teams to understand business requirements and design solutions.
- Staying up-to-date with industry trends and best practices in Hadoop development.
Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Minimum of 3 years of experience working with Hadoop.
- Solid understanding of Hadoop ecosystem components such as HDFS, MapReduce, Hive, Pig, Sqoop, and Oozie.
- Experience with ETL tools such as Talend, Informatica, or DataStage.
- Proficient in programming languages such as Java, Python, or Scala.
- Strong SQL skills and experience with relational databases such as MySQL, Oracle, or SQL Server.
- Knowledge of data warehousing concepts and design principles.
- Experience with cloud-based Hadoop solutions such as AWS EMR or Azure HDInsight is a plus.
- Excellent problem-solving and analytical skills.
- Ability to work independently and in a team environment.
- Strong communication and interpersonal skills.
We offer competitive salaries, comprehensive benefits, and a collaborative work culture. Apply now and become a valuable member of our Hadoop development team!