Join our team and be part of a company that is passionate about utilizing data to drive business decisions and provide value to our customers
Job Title: Hadoop Developer
Location: New York, New York, United States
Salary: $100 Per hour
As a Hadoop Developer, you will play a critical role in our data engineering team to build and maintain our Hadoop-based data platform. You will be responsible for designing, developing, testing, and deploying large-scale data processing applications using Hadoop ecosystem technologies such as HDFS, MapReduce, Hive, Spark, and Kafka.
Key Responsibilities:
- Design, develop, and implement data ingestion and processing pipelines on the Hadoop platform.
- Collaborate with data scientists and analysts to understand their data requirements and translate them into technical solutions.
- Develop and maintain ETL processes to transform and load data from various sources into Hadoop.
- Create and maintain data models and data structures to support data analysis and reporting.
- Monitor and troubleshoot the performance of Hadoop clusters and tune as needed.
- Work with cross-functional teams to integrate Hadoop-based solutions with other systems and applications.
- Stay up-to-date with the latest trends and advancements in Hadoop ecosystem technologies and recommend improvements to our data platform.
- Mentor junior developers and provide technical guidance and support to other team members.
Qualifications:
- Bachelor's degree in Computer Science, Software Engineering, or a related field.
- Minimum of 3 years of experience in developing and deploying Hadoop-based applications.
- Strong understanding of Hadoop ecosystem and its components.
- Proficient in programming languages such as Java, Python, and Scala.
- Experience with ETL tools and processes, data warehousing, and data modeling.
- Familiarity with SQL and NoSQL databases.
- Excellent problem-solving and analytical skills.
- Strong communication and teamwork skills.
- Ability to work in a fast-paced and dynamic environment.
Preferred Qualifications:
- Experience with cloud-based Hadoop services such as Amazon EMR, Google Dataproc, or Microsoft Azure HDInsight.
- Certification in Hadoop technologies.
- Experience with data visualization tools such as Tableau or PowerBI.
- Familiarity with machine learning and data mining techniques.
- Knowledge of agile software development methodologies.
As a Hadoop Developer, you will have the opportunity to work on cutting-edge technologies and collaborate with a talented team to solve complex data challenges. Apply now and take the next step in your career!