Key Responsibilities:

Design, develop, and implement data solutions using Apache Spark
Collaborate with senior developers and data scientists to understand business requirements and translate them into technical specifications
Develop and maintain efficient data pipelines for processing large volumes of data
Optimize and tune Spark jobs for maximum performance
Troubleshoot and resolve any issues related to Spark jobs
Integrate data from various sources and perform data cleansing and transformations
Implement data security and privacy measures to ensure data integrity and compliance
Monitor and maintain the health of Spark clusters and associated infrastructure
Document all development processes and procedures for future reference

Qualifications:

Bachelor's degree in Computer Science, Software Engineering, or a related field
Minimum of 1 year of experience in software development, preferably with a focus on big data technologies
Strong understanding of Apache Spark and its ecosystem (Spark SQL, Spark Streaming, MLlib, etc.)
Proficient in programming languages such as Scala, Java, or Python
Experience with data warehousing, data modeling, and ETL processes
Familiarity with cloud computing platforms (AWS, Azure, etc.) and distributed computing frameworks (Hadoop, Kafka, etc.)
Excellent problem-solving and analytical skills
Ability to work independently as well as in a team environment
Strong communication and interpersonal skills

We offer a competitive salary, a comprehensive benefits package, and a collaborative and supportive work culture. Join us and be a part of our exciting journey in transforming data into valuable insights. Apply now!

Hashtags