Big Data Hadoop Engineer

If you are a highly motivated and experienced Big Data Hadoop Engineer looking to join a fast-paced and innovative team, we encourage you to apply

Title: Big Data Hadoop Engineer

Location: New York, New York, United States

Salary: $138 Per hour

Company: Lobox

Employment Type: Contract

Job Function: Information Technology

Industry: Information Technology & Services

Experience: 20+ years

Job Description: We are seeking a highly skilled Big Data Hadoop Engineer to join our dynamic and growing team. As a Big Data Hadoop Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems using Hadoop and other technologies. You will work closely with our data scientists and analysts to ensure efficient and accurate data processing and analysis to drive business decisions.

Key Responsibilities:

• Design and develop large-scale data processing systems using Hadoop and other Big Data technologies
• Work closely with data scientists and analysts to understand business requirements and design data solutions to meet their needs
• Develop and maintain data pipelines to extract, transform, and load data from various sources into our Hadoop ecosystem
• Monitor data processing performance and optimize system performance to ensure efficient and timely data processing
• Troubleshoot and resolve any issues with data processing and ensure data quality and accuracy
• Collaborate with cross-functional teams to integrate data from various sources and systems
• Develop and maintain documentation for data processing systems and procedures
• Stay up-to-date with the latest technologies and trends in Big Data and Hadoop to continuously improve and enhance our data processing capabilities

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field
• Minimum of 3-5 years of experience in Big Data engineering, with a strong understanding of Hadoop ecosystem and related technologies such as Spark, Hive, and Pig
• Proficient in programming languages such as Java, Python, or Scala
• Experience with data ingestion, transformation, and processing using tools such as Apache Kafka, Apache NiFi, and Apache Sqoop
• Knowledge of database technologies such as SQL, NoSQL, and HBase
• Experience with cloud computing platforms such as AWS, Azure, or Google Cloud
• Strong analytical and problem-solving skills with a keen attention to detail
• Excellent communication and teamwork skills
• Ability to work in a fast-paced and dynamic environment
• Proven experience in delivering high-quality solutions on time and within budget

Benefits:

• Family and medical leave (FMLA)
• Competitive salary and benefits package
• Opportunities for career growth and development
• Collaborative and inclusive work culture
• Access to the latest technologies and tools
• Flexible work schedule and remote work options
• Company-sponsored training and certifications

We are committed to diversity and inclusion in our workplace and welcome candidates from all backgrounds to join our team.