Key Responsibilities:

Design, implement, and maintain our Spark-based data processing and analytics platform
Develop and optimize Spark jobs to process and analyze large volumes of data in real-time
Collaborate with data scientists, software engineers, and data analysts to understand business requirements and translate them into technical solutions
Troubleshoot and debug production issues in a timely manner
Monitor and optimize the performance of the Spark platform
Develop and maintain data pipelines to ingest, transform, and store data from various sources
Implement and maintain data security and data governance policies
Keep up-to-date with the latest developments in Spark and big data technologies and make recommendations for continuous improvement

Qualifications:

Bachelor's or Master's degree in Computer Science, Information Systems, or a related field
Minimum of 3 years of experience working with Spark, preferably in a production environment
Strong knowledge of Spark architecture, internals, and programming model
Proficient in Scala or Java, with the ability to write efficient and optimized code
Experience with big data technologies such as Hadoop, Hive, and Kafka
Experience with cloud computing platforms such as AWS, Azure, or GCP
Familiarity with data warehousing, ETL processes, and data modeling
Excellent problem-solving and analytical skills
Strong communication and collaboration skills
Ability to work independently and in a team environment
Proven track record of delivering high-quality, scalable, and reliable solutions

Opportunity to work with cutting-edge technologies in a fast-paced and dynamic environment
Collaborative and inclusive work culture that values diversity and encourages innovation
Competitive salary and benefits package
Continuous learning and career growth opportunities
Work-life balance and flexible work arrangements

Apply now!

Hashtags