If you are passionate about big data and have a strong background in cloud technologies, we would love to hear from you
Job Title: Big Data Cloud Engineer
Location: San Francisco, California, United States
Salary: $247000 - $320000
Job Overview: We are looking for a highly skilled and experienced Big Data Cloud Engineer to join our dynamic team. As a Big Data Cloud Engineer, you will play a crucial role in designing, building, and maintaining our cloud-based big data infrastructure. You will be responsible for ensuring the scalability, reliability, and performance of our big data systems, as well as implementing cutting-edge technologies and best practices.
Key Responsibilities:
- Design, build, and maintain our cloud-based big data infrastructure using technologies such as Hadoop, Spark, Kafka, and other big data tools.
- Work closely with data scientists and analysts to understand their data needs and design and implement data pipelines that meet those needs.
- Develop and maintain ETL processes for data ingestion, transformation, and loading into our big data systems.
- Monitor and troubleshoot performance and reliability issues, and proactively implement solutions to ensure the smooth functioning of our big data infrastructure.
- Implement and maintain data security and governance policies and procedures to ensure the confidentiality, integrity, and availability of our data.
- Collaborate with cross-functional teams to identify and implement new technologies and tools to improve the efficiency and effectiveness of our big data systems.
- Stay up-to-date with the latest trends and advancements in big data and cloud technologies, and continuously evaluate and recommend improvements to our infrastructure.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
- Minimum of 5 years of experience in designing and building big data systems, preferably in a cloud environment.
- Extensive experience with big data tools and technologies such as Hadoop, Spark, Kafka, and NoSQL databases.
- Strong programming skills in languages such as Java, Python, or Scala.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud.
- Knowledge of data security and governance principles and best practices.
- Excellent problem-solving and troubleshooting skills.
- Ability to work in a fast-paced and dynamic environment, and able to handle multiple tasks simultaneously.
- Strong communication and collaboration skills, with the ability to work effectively in a team.
Join our team and be part of a growing organization that values innovation, teamwork, and continuous learning. Apply now and take the next step in your career as a Big Data Cloud Engineer!