Principal Streaming Data Engineer

If you are a highly motivated and experienced data engineer with a passion for building real-time data solutions, we encourage you to apply for the role of Principal Streaming Data Engineer

Job Title: Principal Streaming Data Engineer

Location: New York, New York, United States

Salary: $247000 - $288000

Position Overview: We are seeking a highly skilled and experienced Principal Streaming Data Engineer to join our dynamic team. As the Principal Streaming Data Engineer, you will be responsible for designing, developing, and implementing real-time data streaming solutions to support our company's business objectives. The ideal candidate will have a strong background in data engineering and a proven track record in building and deploying scalable and reliable streaming data pipelines.

Key Responsibilities:

• Design, develop, and implement real-time data streaming solutions using cutting-edge technologies such as Apache Kafka, Spark Streaming, and Flink
• Work closely with cross-functional teams to gather requirements and understand business needs for real-time data processing
• Build and maintain scalable and robust data pipelines to process high volumes of data in real-time
• Optimize data ingestion, processing, and delivery processes to ensure high performance and low latency
• Collaborate with data scientists and analysts to integrate streaming data into our analytics and machine learning systems
• Lead the development and implementation of best practices for data streaming, including data quality, monitoring, and troubleshooting
• Stay up-to-date with industry developments and emerging technologies in data streaming and recommend innovative solutions to improve our data infrastructure
• Mentor and provide technical guidance to junior team members, promoting a culture of learning and continuous improvement

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• Minimum of 8 years of experience in data engineering, with a focus on real-time data streaming
• Strong experience with data streaming technologies such as Apache Kafka, Spark Streaming, and Flink
• Proficient in programming languages such as Java, Scala, and Python
• Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud
• Proven track record in building and deploying large-scale data pipelines in a production environment
• Knowledge of data warehousing and ETL tools such as Snowflake, Informatica, or Talend
• Excellent problem-solving and analytical skills with a strong attention to detail
• Ability to work in a fast-paced, collaborative environment and manage multiple projects simultaneously
• Strong communication skills and ability to effectively communicate complex technical concepts to non-technical stakeholders

Join our team and be a part of a fast-growing company that values innovation, collaboration, and continuous learning.