Streaming Data Engineer

Joining our team as a Streaming Data Engineer will give you the opportunity to work in a fast-paced, innovative, and collaborative environment

Job Title: Streaming Data Engineer

Location: New York, New York, United States

Salary: $92 Per hour

Position Overview: We are seeking a highly skilled Streaming Data Engineer to join our dynamic team. In this role, you will be responsible for building and maintaining real-time data pipelines to support our streaming data applications. You will work closely with our data scientists and cross-functional teams to design, develop, and deploy scalable streaming data solutions. The ideal candidate will have a strong background in data engineering, expertise in streaming technologies, and a passion for solving complex data challenges.

Key Responsibilities:

• Design, develop, and maintain real-time data pipelines using streaming technologies such as Apache Kafka, Spark Streaming, and Flink.
• Collaborate with data scientists and other stakeholders to understand business requirements and translate them into technical specifications for streaming data solutions.
• Optimize data pipelines for performance, scalability, and reliability.
• Troubleshoot and resolve issues with data pipelines in a timely manner.
• Monitor and analyze the performance of streaming data applications to identify areas for improvement.
• Stay up-to-date with the latest technologies and tools in the streaming data space and make recommendations for continuous improvement.
• Work with cross-functional teams to ensure data quality and consistency across different systems.
• Document data pipelines, processes, and procedures for easy maintenance and knowledge sharing.
• Participate in code reviews and provide feedback to ensure high-quality code is delivered.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Minimum of 3 years of experience working as a Data Engineer, preferably with a focus on streaming data.
• Strong experience with streaming technologies such as Apache Kafka, Spark Streaming, and Flink.
• Proficiency in programming languages such as Java, Scala, or Python.
• Experience working with cloud-based data solutions (AWS, GCP, or Azure).
• Familiarity with data modeling, data warehousing, and ETL processes.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Ability to work independently as well as in a team environment.
• Experience with agile methodologies is a plus.

You will have the chance to make a significant impact on our data infrastructure and play a crucial role in driving data-informed decisions. If you are a self-motivated, data-driven professional with a passion for building scalable and robust streaming data solutions, we would love to hear from you!