Data Pipeline Manager

We offer competitive compensation, a comprehensive benefits package, and a positive and collaborative work environment

Position: Data Pipeline Manager

Location: San Francisco, California, United States

Salary: $209000 - $240000

Overview: We are seeking a highly skilled and experienced Data Pipeline Manager to join our dynamic team. The Data Pipeline Manager will be responsible for designing, implementing, and managing data pipelines to support our organization's data needs. This role requires a deep understanding of data management principles, as well as strong technical skills and leadership abilities. The ideal candidate will have a proven track record of successfully managing complex data pipelines and delivering high-quality data solutions.

Key Responsibilities:

• Design and implement data pipelines to support various data sources and types, such as structured, unstructured, and real-time data.
• Collaborate with cross-functional teams to understand data requirements and design efficient and scalable data pipelines.
• Manage the entire data pipeline lifecycle, including data ingestion, transformation, and delivery, while ensuring data quality and consistency.
• Monitor and troubleshoot data pipeline performance and make necessary adjustments to ensure optimal performance and reliability.
• Develop and maintain documentation for data pipelines, including data mappings, transformations, and data lineage.
• Lead and mentor a team of data engineers to build and maintain data pipelines and deliver high-quality data solutions.
• Stay up-to-date with the latest data management trends and technologies and make recommendations for process improvements and enhancements.

Qualifications:

• Bachelor's degree in Computer Science, Information Systems, or a related field.
• Minimum of 5 years of experience in data management, with at least 3 years of experience in designing and managing data pipelines.
• Proficiency in SQL and experience working with relational databases.
• Strong technical skills in data warehousing, ETL tools, and data integration technologies.
• Experience with cloud-based data platforms, such as AWS, Azure, or Google Cloud.
• Excellent problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data issues.
• Strong leadership and communication skills, with the ability to work collaboratively with cross-functional teams.
• Experience in programming languages, such as Python, Java, or Scala, is a plus.
• Knowledge of data governance and data security best practices is preferred.

If you are a data-driven individual with a passion for managing and optimizing data pipelines, we encourage you to apply for this exciting opportunity. Join us and be a part of a team that is shaping the future of data management.