Data Pipeline Lead

If you are a highly motivated and experienced data professional looking for a challenging and rewarding role, we would love to hear from you

Job Title: Data Pipeline Lead

Location: San Francisco, California, United States

Salary: $190000 - $224000

Overview: As the Data Pipeline Lead, you will play a crucial role in the management and development of our organization's data pipeline infrastructure. This role requires a highly skilled and experienced individual who is passionate about data and has a strong understanding of data engineering and architecture. The ideal candidate will have a proven track record of designing, building, and maintaining data pipelines to support business operations and decision-making processes.

Key Responsibilities:

• Design and build scalable and efficient data pipelines to collect, process, and store data from various sources.
• Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to understand data requirements and implement solutions.
• Lead the development, testing, and deployment of data pipelines, ensuring high-quality data and efficient processing.
• Identify and troubleshoot data pipeline issues, providing timely resolution to minimize downtime and maintain data integrity.
• Develop and maintain documentation for all data pipeline processes, including data sources, transformation logic, and data lineage.
• Stay up-to-date with industry trends and best practices in data engineering, continuously improving data pipeline processes and technologies.
• Mentor and coach junior team members, providing technical guidance and support to enhance their skills and knowledge.

Requirements:

• Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
• Minimum of 5 years of experience in data engineering or a similar role.
• Extensive experience with data pipeline tools and technologies, such as Apache Kafka, Spark, Hadoop, and AWS services.
• Strong programming skills in languages such as SQL, Python, and Java.
• Excellent understanding of data modeling, data warehousing, and ETL processes.
• Experience with data visualization and analytics tools, such as Tableau or Power BI.
• Proven track record of successfully delivering data pipeline projects on time and within budget.
• Strong problem-solving and analytical skills, with a keen eye for detail.
• Excellent communication and collaboration skills, with the ability to articulate complex technical concepts to non-technical stakeholders.

Why join us:

• Opportunity to work with a dynamic and fast-paced team, passionate about data and its impact on business operations.
• Competitive salary and benefits package.
• Continuous learning and development opportunities to enhance your skills and knowledge.
• A culture of innovation and collaboration, where your ideas and contributions are valued.

Join us as our Data Pipeline Lead and be a part of our journey towards leveraging data to drive business success.