Join our team and be a part of a fast-paced, innovative, and collaborative environment where you will have the opportunity to make a significant impact on our data infrastructure
Title: Data Lake Engineer
Location: San Francisco, California, United States
Salary: $152000 - $192000
Overview: We are seeking a highly skilled Data Lake Engineer to join our dynamic and growing team. As a Data Lake Engineer, you will play a critical role in designing, building, and maintaining our data lake infrastructure. You will work closely with our data scientists, analysts, and other engineers to ensure the reliability, scalability, and performance of our data lake. The ideal candidate will have a strong background in data engineering, as well as a passion for working with big data and solving complex problems.
Key Responsibilities:
- Design, build, and maintain our data lake infrastructure using the latest technologies and best practices
- Work closely with data scientists and analysts to understand their data requirements and develop efficient data pipelines
- Optimize data storage, retrieval, and processing performance to ensure the timely and accurate delivery of data to end-users
- Collaborate with cross-functional teams to identify and resolve data quality and integrity issues
- Develop and implement data security measures to protect sensitive data within the data lake
- Continuously monitor and improve the health and performance of the data lake
- Stay up-to-date with industry trends and advancements in data engineering to identify opportunities for improvement and innovation
Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field
- Proven experience as a Data Engineer, Data Lake Engineer, or a similar role
- Strong knowledge of data lake architecture and design principles
- Hands-on experience with big data technologies such as Hadoop, Spark, and Hive
- Experience with cloud-based data lake solutions, preferably on AWS or Azure
- Proficiency in SQL and scripting languages such as Python or Java
- Familiarity with data modeling and ETL processes
- Excellent problem-solving and analytical skills
- Ability to work collaboratively in a fast-paced and dynamic environment
- Strong communication and interpersonal skills
We offer competitive salaries, comprehensive benefits, and a flexible work schedule. If you are passionate about data engineering and looking for a challenging and rewarding career, apply now!