Spark Developer

If you are a passionate Spark Developer looking for a challenging role in a fast-paced environment, we would love to hear from you

Job Title: Spark Developer

Location: New York, New York, United States

Salary: $171000 - $208000

Position Overview: We are seeking a highly skilled Spark Developer to join our dynamic team. As a Spark Developer, you will play a crucial role in developing and maintaining our data analytics platform. You will be responsible for designing, implementing, and optimizing Spark applications to process large datasets in real-time. The ideal candidate will have a strong background in big data technologies, as well as hands-on experience with Spark, Scala, and Hadoop. This is an exciting opportunity to work on cutting-edge projects and contribute to the growth of our company.

Key Responsibilities:

• Design, develop, and maintain Spark applications to process large datasets in real-time
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions
• Optimize Spark jobs for performance and scalability
• Troubleshoot and debug issues in Spark applications
• Design and implement data processing pipelines using Spark, Scala, and Hadoop
• Develop and maintain data ingestion processes from various sources
• Monitor and maintain the health and performance of Spark clusters
• Stay updated with the latest trends and advancements in big data technologies and recommend improvements to the existing data platform
• Create and maintain technical documentation for all Spark applications and processes

Requirements:

• Bachelor's degree in Computer Science, Engineering, or a related field
• Minimum of 3 years of experience as a Spark Developer or in a similar role
• Extensive hands-on experience with Spark, Scala, and Hadoop
• Strong understanding of distributed computing principles and data processing frameworks
• Proficient in SQL and database design
• Experience with cloud platforms such as AWS or Azure
• Experience with real-time data streaming technologies such as Kafka or Flink is a plus
• Proven ability to develop scalable and efficient data processing pipelines
• Excellent problem-solving and analytical skills
• Strong communication and teamwork skills

Perks and Benefits:

• Competitive salary and benefits package
• Flexible work hours and remote work options
• Collaborative and inclusive work environment
• Opportunities for growth and career development
• Cutting-edge technology stack and projects

Join our team and be a part of our journey towards innovation and success.