If you are passionate about big data and have a strong background in Spark, we would love to hear from you
Job Title: Spark Engineer
Location: New York, New York, United States
Job Type: Contract
Salary: $107 Per hour
About the Company: Lobox is a leading technology company that specializes in data analytics and provides cutting-edge solutions to businesses of all sizes. Our team is composed of highly skilled professionals who are passionate about utilizing the latest technologies to drive innovation and growth for our clients.
Job Description: We are seeking a talented and experienced Spark Engineer to join our dynamic team. As a Spark Engineer, you will be responsible for designing, developing, and maintaining our Spark-based data platform. You will work closely with our data scientists and software engineers to implement scalable and efficient solutions for processing and analyzing large datasets.
Key Responsibilities:
- Design and develop Spark-based data pipelines to extract, transform, and load data from various sources
- Collaborate with data scientists to understand their requirements and implement efficient algorithms for data processing and analysis
- Optimize Spark jobs for performance and scalability
- Monitor and troubleshoot issues in the Spark cluster
- Write high-quality, well-documented code and perform code reviews to ensure code quality
- Stay updated with the latest advancements in Spark and big data technologies and incorporate them into our platform
- Work with cross-functional teams to develop solutions that meet business requirements
- Participate in planning and estimation of new projects and features
- Mentor and guide junior team members
Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- Minimum of 3 years of experience working with Spark and big data technologies
- Strong programming skills in Java or Scala
- Experience with Hadoop ecosystem (HDFS, Hive, HBase, etc.)
- Proficient in SQL and experience with relational databases
- In-depth understanding of distributed systems and parallel computing
- Familiarity with cloud computing platforms (AWS, GCP, etc.)
- Excellent problem-solving and analytical skills
- Strong communication and collaboration skills
- Ability to work in a fast-paced and dynamic environment
Perks and Benefits:
- Competitive salary and benefits package
- Opportunity to work with cutting-edge technologies and solve complex problems
- Collaborative and inclusive work culture
- Professional development and growth opportunities
- Flexible work hours and remote work options
Apply now and join our team of talented professionals in driving innovation and delivering top-notch solutions to our clients.