Senior Big Data Operations Specialist

If you are a self-motivated, results-oriented individual with a passion for Big Data and a strong desire to make an impact, we encourage you to apply for this exciting opportunity

Position: Senior Big Data Operations Specialist

Location: New York, New York, United States

Salary: $123 Per hour

Overview: We are seeking a highly skilled and experienced Senior Big Data Operations Specialist to join our dynamic team. As a Senior Big Data Operations Specialist, you will be responsible for managing and maintaining our large-scale data infrastructure, ensuring its high performance, availability, and scalability. You will work closely with our data engineering and analytics teams to support their data needs and enable them to deliver valuable insights to our organization.

Key Responsibilities:

• Manage and maintain our Big Data infrastructure, including Hadoop clusters, NoSQL databases, and other related technologies.
• Monitor and troubleshoot the performance, availability, and scalability of the Big Data infrastructure, ensuring efficient and effective use of resources.
• Work closely with data engineers to design, implement and maintain data pipelines to extract, transform and load data from various sources into the Big Data infrastructure.
• Collaborate with data analysts and data scientists to provide them with the necessary data and tools to perform their analyses and develop data-driven solutions.
• Develop and maintain data governance policies and procedures to ensure data integrity, security, and compliance.
• Conduct regular capacity planning and recommend infrastructure upgrades to support the growing needs of our data-driven organization.
• Stay up-to-date with the latest Big Data technologies and trends, and evaluate their potential impact on our infrastructure and data operations.
• Mentor and train junior data operations team members, sharing your knowledge and experience to help them grow and excel in their roles.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
• Minimum of 5 years of hands-on experience managing and maintaining Big Data infrastructure in a production environment.
• Strong knowledge of Big Data technologies such as Hadoop, Spark, Kafka, and NoSQL databases.
• Proven experience with data pipeline development and management using tools such as Apache Airflow, NiFi, or similar.
• Experience with cloud-based Big Data platforms, such as AWS EMR or Azure HDInsight, is a plus.
• Solid understanding of data governance principles and best practices.
• Strong problem-solving and troubleshooting skills, with the ability to identify and resolve complex technical issues.
• Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
• Proven experience in mentoring and coaching team members.
• Certifications in Big Data technologies are highly desirable.

Join our team and help us drive our organization's success through data-driven insights.