Data Streaming Engineer

As a Data Streaming Engineer, you will have the opportunity to work with cutting-edge technologies and make a significant impact on our data streaming infrastructure

Position: Data Streaming Engineer

Location: San Francisco, California, United States

Salary: $115 Per hour

Job Description: We are seeking a highly skilled Data Streaming Engineer to join our dynamic team. As a Data Streaming Engineer, you will be responsible for designing, building, and maintaining our data streaming infrastructure. You will play a crucial role in ensuring the efficient and reliable flow of data within our organization.

Key Responsibilities:

• Design, develop and implement data streaming solutions using various tools and technologies such as Kafka, Spark Streaming, and NiFi.
• Collaborate with cross-functional teams to understand data requirements and develop streaming solutions that meet business needs.
• Troubleshoot and resolve issues related to data streaming processes, ensuring high availability and performance.
• Monitor and optimize data streaming pipelines to ensure timely and accurate data delivery.
• Develop and maintain documentation for data streaming processes and systems.
• Stay updated with the latest trends and advancements in data streaming technologies and make recommendations for improvements in our infrastructure.

Requirements:

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Minimum of 3 years of experience working with data streaming technologies such as Kafka, Spark Streaming, and NiFi.
• Strong programming skills in Java, Python, or Scala.
• Solid understanding of distributed systems and experience working with large datasets.
• Experience with cloud technologies such as AWS, Azure, or GCP.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.

Preferred:

• Experience with data warehousing and data modeling.
• Knowledge of SQL and NoSQL databases.
• Experience with real-time data processing and analytics.
• Familiarity with DevOps tools and methodologies.

If you are passionate about data and have a strong background in data streaming, we would love to hear from you. Join our team and be part of a fast-paced and innovative environment that values teamwork and continuous learning.