Senior Spark Developer

If you are passionate about data and have a strong background in Spark development, we would love to hear from you

Job Title: Senior Spark Developer

Location: San Francisco, California, United States

Salary: $190000 - $224000

Position Overview: We are seeking a highly skilled and experienced Senior Spark Developer to join our dynamic and innovative team. As the Senior Spark Developer, you will be responsible for designing, developing, and maintaining our Spark-based data processing solutions. You will work closely with our data scientists, software engineers, and other team members to ensure the efficient and accurate processing of large datasets.

Key Responsibilities:

• Design and develop Spark-based data processing solutions to support our data-driven business strategies
• Collaborate with data scientists to understand data requirements and implement efficient data processing pipelines
• Create and maintain ETL processes to extract, transform, and load data from various sources
• Optimize Spark jobs for performance and scalability, ensuring efficient processing of large datasets
• Troubleshoot and resolve issues related to data processing and job failures
• Develop and maintain automated testing scripts to ensure data accuracy and quality
• Participate in code reviews and provide constructive feedback to improve code quality
• Keep up-to-date with the latest Spark features and best practices, and implement them in our data processes
• Mentor and guide junior developers on the team, providing technical guidance and support

Qualifications:

• Bachelor's or Master's degree in Computer Science or a related field
• Minimum of 5 years of experience in software development, with at least 3 years of hands-on experience with Spark
• Strong experience with Java or Scala programming languages
• Extensive knowledge of Spark architecture and its components (Spark Core, Spark SQL, Spark Streaming, etc.)
• Experience with building and optimizing complex ETL processes using Spark
• Solid understanding of database concepts and SQL
• Experience with cloud computing platforms such as AWS, Google Cloud, or Azure
• Familiarity with data warehousing and data modeling concepts
• Excellent problem-solving and analytical skills
• Ability to work independently and in a team environment
• Strong communication and interpersonal skills
• Proven track record of delivering high-quality and scalable solutions in a fast-paced environment

We Offer:

• Competitive salary and benefits package
• Opportunity to work with cutting-edge technologies and solve complex data challenges
• Dynamic and collaborative work environment
• Growth and learning opportunities through training and workshops
• Flexible work hours and work from home options

Join our team and be part of our exciting journey towards leveraging data to drive business success.