Key Responsibilities:

Design, develop, and maintain Spark applications to process large datasets efficiently
Collaborate with data scientists and data engineers to understand business requirements and translate them into technical solutions
Optimize Spark jobs for performance and scalability
Troubleshoot and resolve issues in production environments
Monitor and tune Spark clusters for optimal performance
Stay up-to-date with the latest Spark features and best practices
Participate in code reviews and provide constructive feedback to team members
Contribute to the development of data pipelines and data processing frameworks
Document and communicate technical solutions to both technical and non-technical stakeholders
Continuously improve processes and procedures to increase efficiency and productivity

Qualifications:

Bachelor's or Master's degree in Computer Science, Engineering, or a related field
Minimum of 3 years of experience working with Spark in a production environment
Strong programming skills in Scala, Java, or Python
In-depth understanding of Spark architecture and internals
Experience with big data technologies such as Hadoop, Hive, and Kafka
Proficiency in SQL and data modeling
Familiarity with cloud platforms such as AWS, Azure, or Google Cloud
Ability to troubleshoot and resolve complex technical issues
Excellent communication and collaboration skills
Strong analytical and problem-solving abilities
Proven track record of delivering high-quality, scalable, and efficient Spark solutions

Join our team of talented individuals and make an impact on our data-driven organization. We offer a competitive salary, comprehensive benefits package, and a collaborative work environment. Apply now and be a part of our exciting journey towards innovation and success.

Hashtags