Principal Streaming Data Engineer

If you are a highly motivated and skilled Principal Streaming Data Engineer looking for an exciting new challenge, we want to hear from you! Apply now and join our team of talented professionals.

Job Title: Principal Streaming Data Engineer

Location: New York, New York, United States

Salary: $138 Per hour

Position Overview: We are seeking a highly skilled and experienced Principal Streaming Data Engineer to join our dynamic and innovative team. As the Principal Streaming Data Engineer, you will be responsible for designing, developing, and implementing our streaming data solutions. You will work closely with cross-functional teams to ensure the reliability, scalability, and efficiency of our data streaming platform. The ideal candidate will have a strong background in data engineering, with a focus on streaming technologies, and a passion for solving complex problems.

Key Responsibilities:

• Design and develop scalable, high-performance streaming data pipelines using real-time data processing frameworks such as Apache Kafka, Spark Streaming, and Flink
• Collaborate with data scientists and data analysts to understand business requirements and translate them into technical solutions
• Develop data models and schemas to support streaming data processing and analytics
• Monitor and troubleshoot data streaming pipelines to ensure data quality, accuracy, and availability
• Work closely with DevOps and infrastructure teams to deploy and maintain data streaming infrastructure
• Identify and implement improvements to optimize the performance and cost-efficiency of our data streaming platform
• Stay up-to-date with the latest advancements and best practices in streaming data technologies and recommend their adoption when appropriate

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• 8+ years of experience in data engineering with a focus on streaming data processing
• Strong experience with real-time data processing frameworks such as Apache Kafka, Spark Streaming, and Flink
• Proficiency in programming languages such as Java, Scala, or Python
• Experience with cloud platforms such as AWS, Azure, or GCP
• In-depth understanding of data modeling, data warehousing, and ETL concepts
• Familiarity with data governance and data security principles
• Excellent problem-solving and analytical skills
• Strong communication and interpersonal skills
• Proven ability to work in a fast-paced, agile environment and manage multiple priorities simultaneously

We Offer:

• Competitive salary and benefits
• A collaborative and inclusive work environment
• Opportunities for learning and growth
• Work-life balance
• The chance to work on cutting-edge technologies and make a real impact