Senior Spark Developer

If you are a self-motivated and results-driven individual with a passion for Spark development, we want to hear from you! Apply now and become a part of our growing team of talented developers.

Job Title: Senior Spark Developer

Location: San Francisco, California, United States

Salary: $190000 - $224000

Position Overview: We are seeking a highly experienced Senior Spark Developer to join our dynamic team. As a Senior Spark Developer, you will be responsible for designing, developing, testing, and implementing complex Spark applications. You will work closely with cross-functional teams to analyze business requirements, identify opportunities for improvement, and develop innovative solutions using Spark technology. The ideal candidate will have a strong background in data engineering and a deep understanding of Spark architecture.

Key Responsibilities:

• Design, develop, and maintain high-performance Spark applications to support various business needs
• Collaborate with data analysts and data scientists to understand business requirements and translate them into technical specifications
• Build efficient and reliable data pipelines using Spark to process large volumes of data
• Optimize Spark jobs for performance and scalability
• Troubleshoot and resolve issues related to data processing, job failures, and system performance
• Identify and implement best practices for data storage, data transformation, and data quality assurance
• Develop and maintain documentation for all Spark applications and data pipelines
• Stay up-to-date with the latest Spark releases, updates, and trends in the Big Data ecosystem
• Mentor and provide technical guidance to junior members of the team

Qualifications:

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field
• Minimum of 5 years of experience in software development, with at least 3 years of experience in Spark development
• Strong proficiency in Scala, Java, or Python
• In-depth knowledge of Spark architecture and internals, including Spark SQL, Spark Streaming, and Spark MLlib
• Experience with distributed data processing frameworks such as Hadoop, Hive, or Kafka
• Experience with cloud-based data platforms such as AWS or Azure
• Proficient in SQL and database design principles
• Familiarity with Agile development methodologies
• Excellent analytical and problem-solving skills
• Strong communication and collaboration skills
• Ability to work independently and in a team environment

Why Join Us:

• Opportunity to work with cutting-edge technologies and make a significant impact on our business
• Collaborative and supportive work culture that encourages innovation and personal growth
• Competitive salary and benefits package
• Flexible work arrangements and a healthy work-life balance
• Professional development opportunities to enhance your skills and knowledge
• Dynamic and diverse team with a passion for technology and data-driven solutions