Senior Big Data Operations Specialist

Join our team and be a part of a fast-paced and innovative company that is at the forefront of leveraging big data for business success

Title: Senior Big Data Operations Specialist

Location: San Francisco, California, United States

Salary: $228000 - $256000

Role Summary: We are seeking a highly skilled and experienced Senior Big Data Operations Specialist to join our dynamic team. The ideal candidate will have extensive knowledge and experience in managing big data operations, with a focus on optimizing performance, scalability, and reliability. As a Senior Big Data Operations Specialist, you will be responsible for maintaining and monitoring our big data infrastructure, as well as providing support to our data engineering and analytics teams.

Key Responsibilities:

• Design, implement and maintain big data infrastructure, ensuring optimal performance, scalability, and reliability.
• Monitor and troubleshoot issues with the big data platform, including Hadoop clusters, Spark, and other related components.
• Collaborate with data engineering and analytics teams to understand their needs and provide support for their data processing and analysis tasks.
• Identify and implement improvements to the big data infrastructure, including automation and streamlining processes.
• Develop and maintain documentation for the big data platform, including operational procedures, troubleshooting guides, and best practices.
• Stay updated with the latest technologies and trends in big data operations and make recommendations for their implementation.
• Participate in on-call rotation for after-hours support and incident response.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
• Minimum of 5 years of experience in managing big data operations, preferably in a high-volume environment.
• Strong understanding of big data technologies, including Hadoop, Spark, Hive, and HBase.
• Experience with cloud-based big data platforms, such as AWS or Azure.
• Proven experience in troubleshooting and resolving complex performance and reliability issues in big data environments.
• Proficient in programming and scripting languages, such as Python, Java, and Shell.
• Excellent analytical and problem-solving skills.
• Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.
• Experience with Agile methodologies and DevOps practices.
• Certifications in big data technologies, such as Cloudera or Hortonworks, are a plus.

As a Senior Big Data Operations Specialist, you will have the opportunity to work with cutting-edge technologies and collaborate with a talented team to drive the growth and success of our big data platform. Apply now and take the next step in your career!