Senior Spark Developer

We offer a competitive salary and benefits package, as well as a dynamic and collaborative work environment where your ideas and contributions will be valued

Position: Senior Spark Developer

Location: New York, New York, United States

Salary: $107 Per hour

Job Summary: We are seeking a highly experienced Senior Spark Developer to join our dynamic and innovative team. As a Senior Spark Developer, you will be responsible for developing and maintaining large-scale, distributed data processing systems using Apache Spark. In this role, you will work closely with cross-functional teams to design, develop, and implement solutions that will drive business outcomes and improve overall performance.

Key Responsibilities:

• Develop and maintain scalable and fault-tolerant data processing pipelines using Apache Spark
• Design and implement efficient algorithms to process and analyze large datasets
• Collaborate with data scientists and data analysts to understand business needs and translate them into technical solutions
• Optimize and tune Spark jobs for performance and efficiency
• Troubleshoot and resolve issues in production environments
• Mentor and coach junior team members and lead code reviews to maintain high-quality codebase
• Stay up-to-date with the latest technologies and trends in the Big Data ecosystem and identify opportunities for improvement and innovation
• Participate in Agile development processes and contribute to the team's continuous improvement efforts

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• Minimum of 5 years of hands-on experience with Apache Spark
• Proficiency in programming languages such as Scala, Java, or Python
• Experience with Hadoop ecosystem components such as HDFS, YARN, and Hive
• Strong understanding of distributed systems and parallel computing concepts
• Proven track record of delivering large-scale, high-performance data processing solutions
• Experience with stream processing frameworks such as Spark Streaming or Kafka is a plus
• Excellent problem-solving skills and attention to detail
• Strong communication and collaboration skills to work effectively in a team environment
• Ability to handle multiple tasks and prioritize work in a fast-paced, dynamic environment

If you are a passionate and driven Senior Spark Developer looking for a new challenge, we would love to hear from you. Apply now and join our team of talented individuals who are shaping the future of data processing.