Join our team and be a part of our exciting journey towards building a robust and scalable data lake infrastructure
Job Title: Data Lake Engineer
Location: New York, New York, United States
Salary: $92 Per hour
Position Summary: We are seeking a highly skilled and experienced Data Lake Engineer to join our dynamic and innovative team. As a Data Lake Engineer, you will be responsible for designing, building, and maintaining our data lake infrastructure. This role requires strong technical expertise in data lake architecture, cloud computing, and data management. As a key member of our data engineering team, you will play a critical role in shaping our data lake strategy and ensuring the availability and reliability of our data for analytics and reporting purposes.
Key Responsibilities:
- Design and implement a scalable and efficient data lake architecture, leveraging cloud-based technologies such as AWS, Azure, or Google Cloud Platform
- Develop and maintain ETL processes to ingest data from various sources into the data lake
- Build data pipelines and workflows to transform and cleanse data for analysis and reporting
- Optimize data storage and retrieval for maximum performance and cost efficiency
- Collaborate with data scientists and analysts to understand data requirements and ensure data availability for analytics and reporting
- Monitor and troubleshoot data lake performance and availability issues
- Implement data security and access controls to ensure data privacy and compliance with regulations
- Document data lake processes, procedures, and standards
- Stay updated with industry trends and advancements in data lake technologies and make recommendations for continuous improvement
- Mentor and train junior data engineers on data lake best practices and technologies
Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field
- Minimum of 5 years of experience in data engineering, with at least 2 years of experience in building and maintaining data lakes
- Strong understanding of data lake architecture, data modeling, and data warehousing concepts
- Extensive experience with cloud-based data lake technologies such as AWS S3, EMR, Redshift, Azure Data Lake, or Google BigQuery
- Proficient in SQL and programming languages such as Python, Java, or Scala
- Experience with ETL tools and data integration platforms
- Hands-on experience with data visualization tools such as Tableau or Power BI
- Knowledge of data security and privacy regulations such as GDPR and CCPA
- Strong analytical and problem-solving skills
- Excellent communication and collaboration skills
- Ability to work in a fast-paced environment and manage multiple priorities
- Experience in mentoring and coaching junior team members is a plus
If you are passionate about data and have a strong technical background, we would love to hear from you. Apply now and become a valuable member of our data engineering team!