Senior Data Pipeline Engineer

If you are a passionate and driven Senior Data Pipeline Engineer with a strong background in data engineering and a desire to work in a fast-paced and dynamic environment, then we want to hear from you

Job Title: Senior Data Pipeline Engineer

Location: San Francisco, California, United States

Salary: $228000 - $256000

Job Summary: We are seeking a highly skilled Senior Data Pipeline Engineer to join our dynamic and innovative team. As a Senior Data Pipeline Engineer, you will play a crucial role in designing, developing, and maintaining our data pipeline infrastructure. Your expertise in data management, data processing, and pipeline architecture will be instrumental in enabling us to efficiently and accurately process and analyze large volumes of data. You will work closely with cross-functional teams to identify and implement solutions that meet our business and technical needs. This is an exciting opportunity to be part of a growing company and make a significant impact on our data-driven operations.

Key Responsibilities:

• Design, develop, and maintain data pipelines to collect, process, and store large volumes of data from multiple sources
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and design scalable and efficient solutions
• Optimize and tune data pipelines for maximum performance and reliability
• Identify and troubleshoot data quality issues and implement solutions to ensure data accuracy and integrity
• Develop and maintain documentation for data pipelines, including data flow diagrams, data dictionaries, and standard operating procedures
• Monitor and maintain data pipeline health and proactively identify and resolve any issues
• Stay updated with the latest technologies and trends in data engineering and implement best practices to improve data pipeline efficiency and effectiveness
• Mentor and provide technical guidance to junior data engineers in the team

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• Minimum of 5 years of experience in data engineering, data warehousing, or a similar role
• Strong experience in designing and developing data pipelines using ETL tools such as Apache Airflow, Talend, or Informatica
• Proficient in SQL and programming languages such as Python, Java, or Scala
• In-depth knowledge of database management systems, data modeling, and data warehousing concepts
• Hands-on experience with cloud-based data platforms such as AWS, GCP, or Azure
• Familiarity with big data technologies such as Hadoop, Spark, or Kafka
• Proven track record of delivering data engineering projects on time and within budget
• Excellent problem-solving and analytical skills
• Strong communication and collaboration skills
• Ability to work independently and in a team environment

Apply now and join our team of talented professionals in revolutionizing the way we manage and use data.