Spark Engineer

Lobox is an equal opportunity employer and is committed to providing employment accommodation in accordance with the Ontario Human Rights Code and the Accessibility for Ontarians with Disabilities Act

Position: Spark Engineer

Location: New York, New York, United States

Salary: $190000 - $224000

Employment Type: Full-time

Experience: 8-12 years

Industry: Information Technology & Services

Job Functions: Information Technology, Engineering, Data Science

Introduction: Lobox is seeking a highly skilled and experienced Spark Engineer to join our dynamic and innovative team. As a Spark Engineer, you will have the opportunity to work on cutting-edge projects and utilize your expertise in Spark to drive data-driven solutions for our company. This is a great opportunity for a motivated individual to make a significant impact in a fast-paced and collaborative environment.

Key Responsibilities:

• Design and develop scalable and efficient data processing solutions using Spark
• Collaborate with cross-functional teams to understand business requirements and translate them into technical requirements
• Build and maintain data pipelines to ingest and process large volumes of data
• Optimize Spark jobs for performance, scalability, and reliability
• Troubleshoot and resolve issues related to Spark infrastructure and applications
• Monitor and maintain Spark clusters to ensure high availability and efficiency
• Stay updated with the latest developments in Spark and recommend improvements to existing processes
• Mentor and guide junior team members on Spark best practices and coding standards

Requirements:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• Minimum of years of experience working with Spark in a production environment
• Strong proficiency in programming languages such as Scala, Java, or Python
• Experience with distributed computing frameworks such as Hadoop or Apache Spark
• In-depth knowledge of Spark architecture and Spark internals
• Hands-on experience with Spark SQL, Spark Streaming, and Spark MLlib
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud
• Excellent problem-solving and analytical skills
• Ability to work independently and collaboratively in a team environment
• Strong communication and interpersonal skills

Why Lobox?

At Lobox, we value our employees and their contributions. As a Spark Engineer, you will have the opportunity to work on challenging projects and enhance your skills while working alongside a team of talented individuals. We offer a competitive salary, comprehensive benefits package, and a flexible work schedule. Join us and be a part of our journey towards innovation and success.

To apply, please submit your resume and cover letter highlighting your relevant experience and qualifications. We thank all applicants for their interest, however, only those selected for an interview will be contacted.

If contacted for an interview, please advise us if you require accommodation.