If you are a highly motivated and skilled Senior Streaming Data Engineer looking for a challenging and rewarding opportunity, we encourage you to apply and join our team
Position: Senior Streaming Data Engineer
Location: San Francisco, California, United States
Salary: $107 Per hour
Overview: We are seeking a highly skilled and experienced Senior Streaming Data Engineer to join our dynamic and innovative team. As a Senior Streaming Data Engineer, you will be responsible for designing, developing, and maintaining our company's streaming data pipelines and systems. You will play a critical role in ensuring the efficient and accurate collection, processing, and analysis of real-time data, enabling our company to make data-driven decisions.
Responsibilities:
- Design, develop, and maintain real-time streaming data pipelines and systems.
- Ensure the efficient and accurate collection, processing, and analysis of real-time data.
- Collaborate with cross-functional teams to understand data requirements and design solutions to meet business needs.
- Develop and maintain data quality and monitoring processes to ensure the accuracy and reliability of data.
- Troubleshoot and resolve data pipeline and system issues in a timely manner.
- Optimize and tune data pipelines and systems for optimal performance.
- Stay up-to-date with emerging technologies and industry trends related to streaming data processing and analysis.
- Mentor and provide technical guidance to junior data engineers.
Requirements:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Minimum of 5 years of experience in data engineering, with a focus on streaming data processing and analysis.
- Strong programming skills in languages such as Java, Python, or Scala.
- Experience with streaming data processing frameworks such as Apache Kafka, Spark Streaming, or Flink.
- Solid understanding of distributed systems and data storage technologies, such as Hadoop, AWS S3, or Google BigQuery.
- Experience with cloud platforms, such as AWS, Azure, or Google Cloud.
- Proven track record of designing and implementing complex data pipelines and systems.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration skills.
- Ability to work in a fast-paced and dynamic environment.
Benefits:
- Family leave (Maternity, Paternity)
- Competitive salary and benefits package.
- Opportunities for career growth and advancement.
- Work with a talented and passionate team.
- Flexible work arrangements.
- On-site gym and wellness programs.
- Company-sponsored events and activities.
We are committed to creating an inclusive and diverse work environment and welcome applicants from all backgrounds.