Data Pipeline Engineer

If you are passionate about data engineering and looking for an exciting opportunity to make a significant impact, we would love to hear from you

Title: Data Pipeline Engineer

Location: San Francisco, California, United States

Salary: $171000 - $208000

Overview: We are seeking a highly skilled Data Pipeline Engineer to join our dynamic team. As a Data Pipeline Engineer, you will be responsible for designing, building, and maintaining efficient and scalable data pipelines that support our business needs. You will work closely with our data scientists and software engineers to ensure the smooth flow of data and facilitate timely and accurate data analysis. The ideal candidate will have a strong background in data engineering, excellent problem-solving skills, and a passion for data-driven decision making.

Key Responsibilities:

• Design and develop data pipelines to extract, transform, and load data from various sources into our data warehouse
• Collaborate with data scientists and software engineers to understand their data needs and translate them into efficient data pipelines
• Ensure data quality and integrity by implementing data validation and monitoring processes
• Optimize data pipelines for performance and scalability to support large volumes of data
• Troubleshoot and resolve issues related to data pipeline performance, data quality, and data consistency
• Continuously evaluate and improve our data infrastructure and processes to meet evolving business needs
• Stay up-to-date with the latest trends and technologies in data engineering and make recommendations for process improvement

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field
• Minimum of 3 years of experience in data engineering or a similar role
• Strong proficiency in SQL and experience with relational databases such as MySQL, PostgreSQL, or Oracle
• Experience with data pipeline tools such as Apache Airflow, Apache Kafka, or Amazon Kinesis
• Proficient in at least one programming language such as Python, Java, or Scala
• Familiarity with cloud computing platforms like AWS, Azure, or Google Cloud
• Knowledge of data warehousing concepts and data modeling techniques
• Experience working with big data technologies like Hadoop, Spark, or Hive is a plus
• Excellent problem-solving skills and ability to work in a fast-paced and dynamic environment
• Strong communication and collaboration skills to work effectively with cross-functional teams

Why Join Our Team:

• Opportunity to work with cutting-edge technologies and solve complex data challenges
• Collaborative and inclusive work culture that values diversity and promotes personal and professional growth
• Competitive salary and benefits package
• Continuous learning and development opportunities to enhance your skills and knowledge
• Flexible work arrangements and a healthy work-life balance

Apply now and join our team of talented data professionals!