Principal Big Data Operations Specialist

Joining our team as a Principal Big Data Operations Specialist will give you the opportunity to work with cutting-edge technology and make a significant impact on our organization's data operations

Job Title: Principal Big Data Operations Specialist

Location: New York, New York, United States

Salary: $138 Per hour

Position Overview: We are seeking a highly skilled and experienced Principal Big Data Operations Specialist to join our dynamic and innovative team. As a Principal Big Data Operations Specialist, you will be responsible for overseeing the operation and maintenance of our organization's Big Data infrastructure. You will play a critical role in ensuring the smooth and efficient functioning of our Big Data systems, as well as identifying and implementing strategies for optimization and improvement. The ideal candidate will have a strong technical background, excellent problem-solving skills, and a passion for working with cutting-edge technology.

Key Responsibilities:

• Oversee the operation and maintenance of our organization's Big Data infrastructure, including Hadoop, Spark, and other related technologies.
• Develop and implement processes and procedures for managing, monitoring, and troubleshooting Big Data systems.
• Identify and resolve any issues or inefficiencies in the Big Data infrastructure, taking proactive measures to prevent future problems.
• Collaborate with cross-functional teams to ensure the integration of Big Data systems with other business applications and processes.
• Provide technical leadership and guidance to junior team members, helping to develop their skills and knowledge in Big Data operations.
• Conduct regular performance and capacity assessments of the Big Data infrastructure, making recommendations for improvements as needed.
• Stay up-to-date with industry trends and advancements in Big Data technology, and make informed recommendations for the adoption of new tools and technologies.
• Develop and maintain documentation related to Big Data operations, including system architecture, configurations, and processes.
• Work closely with data scientists and analysts to support the delivery of high-quality data for business analytics and reporting purposes.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
• Minimum of 7 years of experience working with Big Data technologies, such as Hadoop, Spark, and related tools.
• Strong understanding of data warehousing and ETL processes.
• Experience with Linux/Unix operating systems and shell scripting.
• Proficiency in programming languages such as Java, Python, or Scala.
• Knowledge of cloud computing and containerization technologies (e.g. AWS, Docker, Kubernetes) is a plus.
• Excellent problem-solving skills and the ability to troubleshoot complex technical issues.
• Strong communication and interpersonal skills, with the ability to work effectively in a collaborative team environment.
• Proven experience in managing and leading technical teams.
• Passion for learning and keeping up-to-date with emerging technologies and trends in Big Data.

If you are a driven and innovative individual with a strong passion for Big Data, we would love to hear from you. Apply now and be a part of our dynamic and fast-paced environment!