We offer a competitive salary and benefits package, as well as opportunities for career growth and development
Job Title: Data Pipeline Lead
Location: New York, New York, United States
Salary: $107 Per hour
Position Overview: We are seeking a highly skilled and experienced Data Pipeline Lead to join our dynamic and fast-paced team. As the Data Pipeline Lead, you will be responsible for overseeing the development and maintenance of our data pipeline infrastructure. This includes leading a team of data engineers and collaborating with cross-functional teams to ensure the efficient and timely flow of data throughout our organization.
Key Responsibilities:
- Lead a team of data engineers to design, implement, and maintain our data pipeline infrastructure.
- Develop and implement best practices for data pipeline development, including data ingestion, transformation, and storage.
- Collaborate with cross-functional teams, including data analysts, data scientists, and software engineers, to identify and understand data requirements.
- Design and implement data quality checks to ensure the accuracy and completeness of data.
- Monitor performance and troubleshoot issues related to data pipeline processes.
- Identify opportunities for process improvement and implement solutions to increase efficiency and scalability.
- Stay up-to-date with industry trends and advancements in data pipeline technologies and tools.
- Mentor and train team members to ensure their growth and development within the organization.
Qualifications:
- Bachelor���s degree in Computer Science, Information Systems, or a related field.
- Minimum of 5 years of experience in data engineering, with at least 2 years in a leadership role.
- Strong knowledge of data pipeline architecture and design principles.
- Proficient in programming languages such as Python, Java, or Scala.
- Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud.
- Familiarity with data warehousing concepts and technologies.
- Knowledge of data modeling and ETL processes.
- Experience with data visualization tools such as Tableau or Power BI.
- Excellent problem-solving and analytical skills.
- Strong communication and interpersonal skills.
- Ability to work in a fast-paced and dynamic environment.
If you are a highly motivated and experienced Data Pipeline Lead, we encourage you to apply and become a part of our team.