As a Data Pipeline Developer, you will have the opportunity to work with a talented team and cutting-edge technologies to build robust data pipelines
Position: Data Pipeline Developer
Location: San Francisco, California, United States
Salary: $190000 - $240000
Job Description: We are seeking a highly skilled and experienced Data Pipeline Developer to join our team. As a Data Pipeline Developer, you will play a key role in designing, building, and maintaining data pipelines that will enable the company to effectively analyze and utilize large volumes of data.
Key Responsibilities:
- Design and develop data pipelines to collect, process, and store data from various sources.
- Collaborate with cross-functional teams to understand data requirements and identify opportunities for data integration.
- Implement data quality checks and data cleansing processes to ensure the accuracy and integrity of the data.
- Monitor and troubleshoot data pipeline issues, and implement solutions to improve performance and reliability.
- Develop and maintain documentation for data pipelines, including data flow diagrams, data dictionaries, and technical specifications.
- Stay up-to-date with new data pipeline technologies and trends, and make recommendations for improving existing processes.
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Minimum of 3 years of experience in a similar role, preferably in a fast-paced environment.
- Strong understanding of data modeling, data warehousing, and ETL principles.
- Proficiency in SQL and experience working with relational databases.
- Experience with programming languages such as Python, Java, or Scala.
- Familiarity with data pipeline tools and technologies such as Apache Spark, Kafka, or Airflow.
- Excellent problem-solving and analytical skills.
- Ability to work independently and in a team environment.
- Strong communication and collaboration skills.
Why Join Us:
- We offer a competitive salary, benefits package, and a dynamic work environment where your ideas and contributions are valued. Join us and be a part of our exciting journey as we continue to grow and innovate in the world of data analytics.