We are looking for a highly motivated and driven individual who is passionate about big data and can thrive in a challenging and fast-paced environment
Job Title: Hadoop Developer
Location: New York, New York, United States
Salary: $100 Per hour
As a Hadoop Developer, you will be responsible for designing, developing, and implementing large scale data processing systems using Hadoop. You will work closely with the data science and engineering teams to understand their requirements and provide scalable solutions to handle large volumes of data.
Key Responsibilities:
- Develop and maintain Hadoop applications and workflows.
- Design and implement data models and schemas for efficient data storage and retrieval.
- Write efficient MapReduce jobs to process and analyze large datasets.
- Develop and maintain data ingestion pipelines from various sources into Hadoop.
- Troubleshoot and resolve issues related to data processing, storage, and retrieval.
- Optimize Hadoop clusters for performance and scalability.
- Work closely with the data science team to understand their requirements and provide solutions for their data processing needs.
- Collaborate with cross-functional teams to integrate Hadoop applications with other systems.
- Stay updated with the latest Hadoop technologies and trends and provide recommendations for improvements.
Requirements:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Minimum of 3 years of experience in designing, developing, and maintaining Hadoop applications.
- Strong knowledge of Hadoop ecosystem tools such as HDFS, Hive, Pig, Spark, etc.
- Hands-on experience with programming languages such as Java, Python, or Scala.
- Experience with SQL and NoSQL databases.
- Familiarity with data modeling and schema design.
- Experience with data ingestion tools such as Sqoop, Flume, or Kafka.
- Strong troubleshooting and problem-solving skills.
- Excellent communication and collaboration skills.
- Ability to work in a fast-paced and dynamic environment.
If you have a strong background in Hadoop development and are looking for an opportunity to work on cutting-edge technologies, we would love to hear from you!