If you are passionate about data and have a strong background in streaming technologies, we would love to hear from you! Apply now and join us on our journey to revolutionize the way we handle data.
Position: Lead Streaming Data Engineer
Location: San Francisco, California, United States
Salary: $228000 - $256000
About the Role: We are seeking a highly skilled and experienced Lead Streaming Data Engineer to join our dynamic team. As the Lead Streaming Data Engineer, you will be responsible for designing, developing, and maintaining our streaming data architecture. You will be a key player in driving our data strategy and ensuring the reliability, scalability, and efficiency of our data systems.
Key Responsibilities:
- Design and implement scalable and reliable streaming data pipelines using technologies such as Kafka, Spark, and Flink.
- Develop and maintain data ingestion processes to ensure timely and accurate delivery of data.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Lead a team of data engineers and provide technical guidance and mentorship.
- Proactively identify and resolve data-related issues and make recommendations for improvements.
- Develop and maintain data quality checks and monitoring processes to ensure data accuracy and integrity.
- Stay up-to-date with the latest advancements in data streaming technologies and continuously evaluate and implement new tools and techniques.
- Participate in code reviews and ensure adherence to coding standards and best practices.
- Contribute to the development of data governance policies and procedures.
Requirements:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 5+ years of experience in data engineering with a strong focus on streaming data technologies.
- Proven experience with streaming data platforms such as Kafka, Spark, or Flink.
- Strong programming skills in languages such as Python, Java, or Scala.
- Experience with cloud-based data technologies, such as AWS or Azure.
- In-depth knowledge of data modeling, database design, and SQL.
- Strong analytical and problem-solving skills.
- Excellent communication and interpersonal skills.
- Experience in a lead or mentorship role is a plus.
Why Join Us?
As a Lead Streaming Data Engineer, you will have the opportunity to make a significant impact on our data infrastructure and play a crucial role in shaping our data strategy. You will work with a talented and collaborative team in a fast-paced and innovative environment. We offer a competitive salary, benefits package, and opportunities for professional growth and development.