Joining our team as a Principal Data Lake Engineer will give you the opportunity to work with cutting-edge technologies and make a significant impact on our data infrastructure
Job Title: Principal Data Lake Engineer
Location: New York, New York, United States
Salary: $247000 - $288000
We are seeking a highly skilled and experienced Principal Data Lake Engineer to join our dynamic and innovative team. As a Principal Data Lake Engineer, you will play a crucial role in designing, building, and maintaining our company's data lake infrastructure. Your expertise in data engineering and architecture will be instrumental in driving our data strategy and ensuring the reliability, scalability, and security of our data lake.
Key Responsibilities:
- Lead the design and development of our data lake infrastructure, including data ingestion, storage, processing, and access layers
- Work closely with cross-functional teams to understand business requirements and translate them into technical solutions
- Define and implement data lake architecture best practices, standards, and guidelines
- Develop and maintain data models, data dictionaries, and data lineage documentation
- Design and implement data quality and governance processes to ensure data accuracy, completeness, and consistency
- Continuously evaluate and improve the performance and scalability of the data lake
- Troubleshoot and resolve complex data issues in a timely manner
- Collaborate with data scientists, analysts, and other stakeholders to support their data needs and enable data-driven decision making
- Mentor and coach junior data engineers, providing technical guidance and sharing best practices
Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field
- Minimum of 8 years of experience in data engineering, with at least 3 years of experience in building and maintaining data lakes
- Strong understanding of data lake architecture and components, such as data ingestion tools, data storage platforms, and data processing frameworks
- Hands-on experience with cloud-based data lake solutions, preferably AWS or Azure
- Proficient in programming languages such as Python, Java, or Scala, and SQL
- Experience with data modeling, data governance, and data quality processes
- Familiarity with data visualization tools, such as Tableau or Power BI, is a plus
- Excellent problem-solving and analytical skills
- Strong communication and collaboration skills
- Ability to work independently and manage multiple projects simultaneously
If you are passionate about data, have a strong technical background, and thrive in a fast-paced and collaborative environment, we would love to hear from you. Apply now and be part of our exciting journey towards becoming a data-driven organization.