Spark Engineer

If you are passionate about big data and have a strong background in Spark, we would love to hear from you! Join us and be part of a dynamic team that is revolutionizing the way businesses harness the power of data

Job Title: Spark Engineer

Location: New York, New York, United States

Salary: $107 Per hour

Company Overview: We are a leading technology company that specializes in providing innovative solutions for data management and analytics. With a team of skilled and passionate individuals, we strive to empower businesses with the tools and expertise to make data-driven decisions.

Position Overview: We are seeking a highly motivated and experienced Spark Engineer to join our team. As a Spark Engineer, you will be responsible for designing, developing, and maintaining our Spark-based data processing systems. You will play a critical role in ensuring the reliability and scalability of our data infrastructure, as well as optimizing performance for our clients.

Key Responsibilities:

• Design, develop, and maintain Spark-based data processing systems
• Work closely with data scientists and analysts to understand business requirements and translate them into technical solutions
• Optimize data pipelines for scalability, reliability, and performance
• Troubleshoot and resolve issues related to data processing and performance
• Collaborate with cross-functional teams to integrate data pipelines with various systems and applications
• Write and maintain technical documentation for data pipelines and systems
• Stay updated with the latest developments and best practices in Spark and big data technologies
• Mentor and coach junior team members to enhance their technical skills and knowledge

Requirements:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• Minimum of 3 years of experience working with Spark and Hadoop ecosystem
• Solid understanding of big data concepts and principles
• Proficient in programming languages such as Java, Scala, or Python
• Experience with SQL and NoSQL databases
• Strong knowledge of data structures and algorithms
• Experience with cloud platforms such as AWS, GCP, or Azure
• Excellent problem-solving and analytical skills
• Strong communication and collaboration skills
• Ability to work in a fast-paced and dynamic environment

Why You Should Join Us:

• Opportunity to work with cutting-edge technologies and solve complex problems
• Collaborative and inclusive work culture that values creativity and diversity
• Competitive salary and benefits package
• Professional development and growth opportunities
• Flexible work hours and work-from-home options
• Fun and engaging team activities and events

Apply now and let's make an impact together!