Principal Data Pipeline Engineer

If you are a highly skilled and experienced data engineer looking for a challenging and rewarding role, we encourage you to apply for the position of Principal Data Pipeline Engineer

Job Title: Principal Data Pipeline Engineer

Location: New York, New York, United States

Salary: $138 Per hour

Overview: We are seeking a highly skilled and experienced Principal Data Pipeline Engineer to join our team. As a Principal Data Pipeline Engineer, you will be responsible for designing, developing, and maintaining data pipelines that support our company's data-driven initiatives. You will work closely with cross-functional teams to ensure efficient and reliable data processing, storage, and retrieval. This is a senior-level position that requires strong technical expertise, leadership skills, and a deep understanding of data engineering principles.

Key Responsibilities:

• Design, build, and maintain data pipelines to support data processing, transformation, and storage.
• Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and develop effective solutions.
• Develop and implement best practices for data pipeline architecture, monitoring, and performance optimization.
• Ensure the scalability, reliability, and security of our data pipelines.
• Troubleshoot and resolve issues with data pipelines, working closely with other engineering teams.
• Keep up-to-date with the latest technologies and industry trends in data engineering and apply them to improve our data pipelines.
• Mentor and lead junior data engineers, providing guidance and support for their professional development.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
• Minimum of 7 years of experience in data engineering, with at least 3 years in a senior or lead role.
• Strong expertise in data pipeline development, with experience in building ETL/ELT processes, data warehousing, and data integration.
• Proficient in programming languages such as Python, Java, or Scala, and experience with data manipulation and processing libraries (e.g. Pandas, Spark).
• Experience with cloud-based data platforms (e.g. AWS, Azure, GCP) and related services (e.g. S3, Redshift, BigQuery).
• In-depth knowledge of SQL and relational databases.
• Familiarity with data modeling and data governance principles.
• Excellent problem-solving skills and ability to troubleshoot complex data issues.
• Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team.
• Proven leadership experience, with the ability to mentor and guide junior team members.

Benefits:

• Disability insurance

Join our dynamic and innovative team and be a part of shaping the future of our company's data infrastructure.