Lead Data Pipeline Engineer

Why Join Us? At Lobox, we value our employees and provide a dynamic and supportive work environment that promotes growth and development

Position: Lead Data Pipeline Engineer

Location: New York, New York, United States

Salary: $130 Per hour

About the Company: Lobox is a leading data-driven company that specializes in providing innovative solutions to businesses of all sizes. Our mission is to empower our clients with data intelligence to make informed decisions and drive success. As a Lead Data Pipeline Engineer, you will play a vital role in designing and implementing robust data pipelines to support our growing business needs.

Job Overview: We are seeking a highly skilled and experienced Lead Data Pipeline Engineer to join our dynamic team. In this role, you will be responsible for leading the development, maintenance, and optimization of our data pipelines. You will work closely with cross-functional teams to ensure the timely delivery of high-quality data to support our business operations.

Key Responsibilities:

• Design, develop, and maintain scalable and efficient data pipelines to support various data-driven applications and processes.
• Lead a team of data engineers and provide technical guidance and mentorship to ensure the successful execution of data pipeline projects.
• Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and design data models.
• Identify and resolve data quality issues and ensure data consistency and accuracy throughout the data pipeline.
• Implement best practices and standards for data pipeline development and maintenance.
• Monitor data pipeline performance and troubleshoot any issues that arise.
• Identify opportunities for optimization and automation of data pipeline processes to improve efficiency and reduce costs.
• Stay updated on the latest tools and technologies in the data engineering field and evaluate their potential use in our data pipeline infrastructure.
• Ensure compliance with data security and privacy regulations.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
• Minimum of 5 years of experience in data engineering, with at least 2 years in a leadership role.
• Strong knowledge of SQL, ETL, and data warehousing concepts.
• Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with data pipeline tools such as Apache Airflow, Apache Spark, or AWS Glue.
• Proven experience in leading a team and delivering complex data pipeline projects.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.

As a Lead Data Pipeline Engineer, you will have the opportunity to work on cutting-edge technologies and make a significant impact on our business. We offer a competitive salary, benefits package, and opportunities for career advancement. Join us and be a part of our journey towards data-driven success.