If you are a highly motivated and innovative data engineer with a passion for developing scalable and robust data lake solutions, we would love to hear from you
Job Title: Principal Data Lake Engineer
Location: New York, New York, United States
Salary: $135 Per hour
Employment Type: Contract
Experience Level: Senior
Industry: Information Technology & Services
Job Function: Engineering, Information Technology
About the Role: We are seeking a highly skilled and experienced Principal Data Lake Engineer to join our dynamic team. As a Principal Data Lake Engineer, you will be responsible for overseeing the development, implementation, and maintenance of our data lake architecture. You will play a critical role in the design and optimization of our data lake infrastructure, ensuring high performance, reliability, and scalability.
Key Responsibilities:
- Design and implement data lake architectures that support the storage, processing, and analysis of large and complex datasets.
- Collaborate with cross-functional teams to understand data requirements and develop data lake solutions that meet business needs.
- Develop and maintain data lake standards, guidelines, and best practices to ensure data quality, consistency, and security.
- Lead the development of data ingestion processes, data transformation pipelines, and data access methods for the data lake.
- Identify and recommend new technologies and tools to improve the performance and efficiency of the data lake.
- Monitor and troubleshoot data lake performance issues, identify root causes, and implement solutions.
- Develop and maintain data governance policies and procedures for the data lake.
- Mentor and guide junior data engineers in data lake development and maintenance tasks.
- Stay up-to-date with industry trends and advancements in data lake technologies and best practices.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Minimum of years of experience in data engineering, with a focus on data lake development.
- Strong experience with cloud-based data lake solutions, such as AWS or Azure.
- Proficiency in programming languages such as Python, Java, or Scala.
- Extensive experience with big data technologies, such as Hadoop, Spark, and Kafka.
- Experience with data modeling, data warehousing, and data integration techniques.
- In-depth knowledge of SQL and NoSQL databases.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- Experience in a leadership or mentorship role is a plus.
Join our team and be a part of an exciting and fast-paced environment where your skills and expertise will be valued and recognized.