Big Data Engineer

If you are a self-motivated and results-driven Big Data Engineer with a passion for solving complex data problems, we would love to hear from you

Position: Big Data Engineer

Location: New York, New York, United States

Salary: $190000 - $224000

Overview: We are seeking a highly skilled Big Data Engineer to join our dynamic team. In this role, you will be responsible for designing, implementing, and maintaining our company's Big Data infrastructure. You will work closely with our data scientists and analysts to ensure the availability, reliability, and scalability of our data systems. The ideal candidate will have a strong background in data engineering and a passion for solving complex problems.

Key Responsibilities:

• Design, build, and maintain our Big Data infrastructure, including data warehouses, data lakes, and ETL pipelines.
• Develop and implement data ingestion processes from various sources, ensuring data quality and consistency.
• Perform data modeling and optimization to support data analytics and reporting.
• Collaborate with data scientists and analysts to understand their data needs and translate them into technical solutions.
• Monitor and troubleshoot data pipelines and systems to ensure their performance and availability.
• Implement security and privacy measures to protect our data assets.
• Stay up-to-date with the latest Big Data technologies and tools, and make recommendations for their adoption.
• Mentor and train junior data engineers to improve their technical skills and knowledge.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in data engineering, with a focus on Big Data technologies.
• Strong experience with SQL and NoSQL databases, such as Hadoop, MongoDB, and Cassandra.
• Proficiency in programming languages like Python, Java, or Scala.
• Experience with data warehousing and ETL tools, such as Redshift, Spark, and Airflow.
• Familiarity with cloud computing platforms, particularly AWS.
• Knowledge of data modeling and optimization techniques.
• Strong problem-solving skills and ability to work in a fast-paced, collaborative environment.
• Excellent communication and teamwork skills.

We Offer:

• Competitive salary and benefits package.
• Opportunity to work with cutting-edge Big Data technologies.
• Professional development and growth opportunities.
• Collaborative and inclusive work environment.

Apply now to become a part of our innovative team!