Join our team and be a part of a company that values innovation, collaboration, and personal growth
Position: Spark Engineer
Location: San Francisco, California, United States
Job Type: Full-time
Salary: $190000 - $224000
Company Description: Lobox
Lobox
At Lobox, we are a leading technology company that specializes in data analytics and business intelligence solutions for our clients. We are passionate about using cutting-edge technologies to help businesses make data-driven decisions and achieve their goals. As we continue to grow, we are seeking a skilled and experienced Spark Engineer to join our dynamic team.
Job Description: As a Spark Engineer, you will play a critical role in designing, developing, and maintaining our data processing pipelines and analytics systems. You will work closely with our data scientists and software engineers to ensure the efficient and reliable delivery of data-driven solutions to our clients. Your expertise in Spark and other big data technologies will be essential in driving the success of our projects.
Key Responsibilities:
- Design, develop, and maintain data processing pipelines and analytics systems using Spark and other big data technologies
- Work closely with data scientists and software engineers to understand project requirements and translate them into scalable and efficient solutions
- Optimize and tune Spark jobs for performance and scalability
- Monitor and troubleshoot data pipelines to ensure data integrity and timely delivery of data
- Collaborate with cross-functional teams to integrate data solutions into existing systems and applications
- Stay up-to-date with new technologies and industry trends to continuously improve our data processing capabilities
- Act as a subject matter expert and provide technical guidance to team members
- Participate in code reviews and ensure adherence to coding standards and best practices
Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- Minimum of 3 years of experience working with Spark and other big data technologies
- Strong proficiency in Scala or Java programming languages
- In-depth knowledge of Spark internals and data structures
- Experience with SQL and NoSQL databases
- Familiarity with cloud computing platforms such as AWS or GCP
- Excellent problem-solving and analytical skills
- Strong communication and teamwork abilities
- Ability to thrive in a fast-paced and dynamic work environment
We offer a competitive salary, comprehensive benefits package, and opportunities for professional development. Apply now and let's make a difference together!