Spark Engineer

If you are passionate about big data and enjoy solving complex problems, we would love to hear from you

Position: Spark Engineer

Location: San Francisco, California, United States

Salary: $190000 - $224000

Company Overview: We are a leading technology company that specializes in data analytics and business intelligence solutions. Our team is dedicated to helping our clients make data-driven decisions and achieve their business goals. We are currently seeking a highly skilled Spark Engineer to join our dynamic team.

Job Overview: As a Spark Engineer, you will be responsible for designing, implementing, and maintaining our data processing infrastructure. You will work closely with our data scientists and software engineers to develop scalable and efficient data solutions. This is a hands-on role that requires a deep understanding of data processing frameworks, particularly Apache Spark.

Key Responsibilities:

• Design, develop, and optimize data pipelines using Spark and other big data technologies
• Collaborate with data scientists to understand their requirements and design scalable solutions
• Fine-tune data processing workflows to ensure optimal performance and reliability
• Troubleshoot and resolve issues in our data infrastructure
• Research and evaluate new technologies to continuously improve our data processing capabilities
• Mentor and provide technical guidance to junior team members
• Collaborate with cross-functional teams to integrate data solutions into our products and services

Qualifications:

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field
• 3+ years of experience working with big data technologies, with a focus on Spark
• Strong proficiency in Scala or Java programming languages
• Experience with data processing frameworks such as Spark, Hadoop, and Kafka
• In-depth understanding of distributed systems and parallel processing
• Familiarity with cloud computing platforms, such as AWS or Azure
• Excellent problem-solving and analytical skills
• Ability to work in a fast-paced, agile environment
• Excellent communication and teamwork skills

Benefits:

• Health care plan (Medical, Dental & Vision)
• Competitive salary and benefits package
• Opportunities for professional growth and career advancement
• Flexible work hours and remote work options
• Collaborative and inclusive work culture
• Fun team events and activities

Join our team of experts and make a difference in the world of data analytics. Apply now!