Key Responsibilities:

Design, develop, and maintain our Spark-based data processing pipelines to support our business needs.
Collaborate with data scientists and software engineers to design and implement efficient data processing algorithms.
Monitor and optimize the performance of our Spark clusters to ensure optimal data processing.
Troubleshoot and resolve any issues that arise in our Spark-based data processing pipelines.
Develop and maintain technical documentation for all Spark-based processes and workflows.
Stay updated with the latest trends and technologies in the Spark ecosystem and make recommendations for adoption.
Mentor and guide junior team members in Spark development best practices.

Qualifications:

Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Minimum of 3 years of experience as a Spark Engineer or a similar role.
Strong experience with Apache Spark and its ecosystem, including Spark SQL, Spark Streaming, and MLlib.
Proficiency in programming languages like Scala or Python.
Hands-on experience with Hadoop and distributed computing.
Experience with cloud platforms like AWS or Azure is a plus.
Strong understanding of data structures, algorithms, and distributed systems.
Excellent problem-solving skills and attention to detail.
Ability to work in a fast-paced and collaborative environment.

Why Work With Us?

We are a dynamic and rapidly growing company that values innovation and teamwork. As a Spark Engineer, you will have the opportunity to work with cutting-edge technologies and collaborate with a diverse team of talented individuals. We offer a competitive salary, comprehensive benefits package, and opportunities for professional growth and development.

Join our team and be a part of shaping the future of data processing with Spark!

We look forward to hearing from you!

Hashtags