Spark Developer

If you are passionate about big data and have a strong background in Spark development, we would love to hear from you

Job Title: Spark Developer

Location: New York, New York, United States

Salary: $171000 - $208000

About the Role: We are seeking a highly skilled and motivated Spark Developer to join our dynamic team. As a Spark Developer, you will be responsible for designing, developing, and implementing data processing solutions using Apache Spark. You will be working closely with our team of data scientists and data engineers to build scalable, real-time data pipelines for our growing business needs. This is a fantastic opportunity for an experienced Spark Developer to make a significant impact on our company's data infrastructure and contribute to our overall success.

Key Responsibilities:

• Design and develop efficient and scalable data pipelines using Apache Spark
• Collaborate with data scientists and data engineers to understand business needs and translate them into technical requirements
• Optimize and tune Spark jobs to improve overall performance and scalability
• Troubleshoot and debug complex issues in the Spark environment
• Develop and maintain documentation for data pipelines and processes
• Keep up-to-date with the latest technologies and trends in the big data ecosystem
• Mentor and coach junior team members on Spark development best practices

Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field
• Minimum of 3 years of hands-on experience working with Apache Spark
• Strong programming skills in Scala, Java, or Python
• Experience with big data technologies such as Hadoop, Hive, and Kafka
• Knowledge of SQL and database systems
• Understanding of data warehousing concepts and ETL processes
• Familiarity with cloud environments such as AWS or Azure
• Excellent problem-solving and analytical skills
• Strong communication and collaboration skills
• Ability to work in a fast-paced and agile environment

Why Work With Us:

• Opportunity to work on cutting-edge technologies and projects
• Collaborative and inclusive work culture
• Competitive salary and benefits package
• Continuous learning and growth opportunities
• Flexible work arrangements
• Supportive and dynamic team environment

Join our team and be part of our journey in revolutionizing the way we process and analyze data. Apply now and let's build something amazing together!