We offer a competitive salary, comprehensive benefits package, and a dynamic work environment where you will have the opportunity to work on cutting-edge Big Data projects
Title: Hadoop Developer
Location: New York, New York, United States
Salary: $171000 - $208000
Job Description: We are seeking a highly skilled Hadoop Developer to join our dynamic team. As a Hadoop Developer, you will be responsible for designing, developing, and implementing Big Data solutions using Hadoop technologies. Your primary focus will be on creating and maintaining Hadoop clusters, developing ETL processes, and writing complex MapReduce programs.
Key Responsibilities:
- Design, develop, and implement scalable and high-performance Big Data solutions using Hadoop ecosystem technologies such as HDFS, MapReduce, Hive, Pig, Spark, and Kafka
- Create and maintain Hadoop clusters, including configuration, installation, and monitoring
- Develop ETL processes to extract, transform, and load data from various data sources into Hadoop
- Write complex MapReduce programs to process large datasets efficiently
- Design and implement data models and data schemas to support data analysis and reporting
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions
- Troubleshoot and resolve issues in Hadoop clusters and ETL processes
- Optimize Hadoop clusters for performance and scalability
- Stay up-to-date with the latest trends and best practices in Big Data and Hadoop technologies
Qualifications:
- Bachelor's degree in Computer Science, Information Systems, or a related field
- Minimum of 3 years of experience as a Hadoop Developer or a similar role
- Strong experience with Hadoop ecosystem technologies such as HDFS, MapReduce, Hive, Pig, Spark, and Kafka
- Experience with ETL tools and processes
- Proficiency in programming languages such as Java, Python, or Scala
- In-depth understanding of data modeling and data warehousing concepts
- Experience with relational databases and SQL
- Excellent problem-solving and analytical skills
- Strong communication and collaboration skills
- Ability to work independently and in a team environment
- Proven track record of delivering high-quality solutions within tight deadlines
If you are a self-motivated, results-driven individual with a passion for Big Data and Hadoop technologies, we would love to hear from you!