If you are a self-starter with a passion for data and a desire to lead and innovate, this is the perfect opportunity for you
Position: Lead Data Lake Engineer
Location: San Francisco, California, United States
Salary: $228000 - $256000
We are seeking a highly skilled and experienced Lead Data Lake Engineer to join our dynamic team. As the Lead Data Lake Engineer, you will be responsible for designing and implementing our data lake infrastructure to support our company's growing data needs. This is a critical role within our organization, and we are looking for a passionate and driven individual to take on this challenge.
Key Responsibilities:
- Lead the design, development, and maintenance of our data lake infrastructure.
- Collaborate with cross-functional teams to understand data requirements and design optimal solutions.
- Develop data ingestion processes to efficiently collect and process large volumes of data from various sources.
- Implement data governance policies and procedures to ensure data accuracy, security, and compliance.
- Design and implement data lake security measures, including access controls and encryption.
- Monitor and optimize data lake performance to ensure efficient data processing and storage.
- Create and maintain documentation for data lake infrastructure, processes, and policies.
- Stay current with industry trends and advancements in data lake technologies and make recommendations for improvement.
Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Minimum of 5 years of experience in data engineering, with at least 2 years of experience in data lake development.
- Proven experience with cloud-based data lake solutions, such as Amazon S3, Azure Data Lake Storage, or Google Cloud Storage.
- Strong knowledge of data lake architecture and design principles.
- Experience with data ingestion tools, such as Apache Kafka, Apache NiFi, or AWS Glue.
- Proficiency in SQL and scripting languages, such as Python and Shell.
- Experience with data governance frameworks and policies.
- Familiarity with data security and encryption techniques.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- Experience in a leadership or mentorship role is a plus.
Join our team as the Lead Data Lake Engineer and be a part of shaping the future of our company's data infrastructure.