If you are a self-motivated individual with a passion for big data and a desire to continuously learn and improve your skills, we would love to have you join our team as a Hadoop Developer
Job Title: Hadoop Developer
Location: New York, New York, United States
Salary: $100 Per hour
As a Hadoop Developer, you will be responsible for designing, developing, and implementing large-scale distributed systems using the Hadoop framework. You will work closely with data scientists, business analysts, and other stakeholders to understand their requirements and develop solutions that meet their needs.
Key Responsibilities:
- Design, develop, and implement Hadoop-based solutions to support data processing and analytics
- Develop data ingestion pipelines to bring in large volumes of data from various sources
- Optimize and tune Hadoop clusters for maximum performance and scalability
- Troubleshoot and resolve issues with Hadoop clusters and related technologies
- Collaborate with data scientists and business analysts to understand data requirements and design data models
- Develop and maintain ETL processes to transform and load data into Hadoop
- Implement data security and access controls to ensure data privacy and compliance
- Conduct thorough testing and debugging of Hadoop applications to ensure high-quality deliverables
- Stay up-to-date with the latest Hadoop ecosystem technologies and industry best practices
- Document technical specifications, processes, and procedures for future reference
Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field
- Minimum of 3 years of experience in Hadoop development and administration
- Strong understanding of Hadoop architecture and distributed systems concepts
- Proficient in programming languages such as Java, Python, or Scala
- Experience with Hadoop ecosystem technologies such as HDFS, MapReduce, Hive, Spark, Kafka, etc.
- Familiarity with cloud computing platforms (AWS, Azure, Google Cloud) and their Hadoop offerings
- Knowledge of SQL and relational databases
- Excellent problem-solving and analytical skills
- Strong communication and collaboration skills
- Ability to work in a fast-paced and dynamic environment
You will have the opportunity to work on cutting-edge projects and make a significant impact on our business. Apply now and be a part of our innovative and dynamic team!