Junior Spark Developer

If you are looking for a rewarding and exciting opportunity to grow your career as a Spark Developer, we encourage you to apply now

Job Title: Junior Spark Developer

Location: San Francisco, California, United States

Salary: $114000 - $136000

Overview: We are seeking a motivated and enthusiastic Junior Spark Developer to join our dynamic team. As a Junior Spark Developer, you will be responsible for developing and maintaining our data processing pipeline using Apache Spark. You will work closely with our team of developers and data scientists to ensure the efficient and accurate processing of large datasets. This is an exciting opportunity for someone who is passionate about big data and wants to gain experience in a fast-paced, cutting-edge environment.

Key Responsibilities:

• Design, develop and maintain data processing pipelines using Apache Spark
• Collaborate with cross-functional teams to understand data requirements and ensure the accuracy and efficiency of data processing
• Troubleshoot and resolve any issues with data pipeline performance or functionality
• Develop and maintain data quality checks to ensure data integrity
• Stay up-to-date with industry trends and best practices in big data and Spark development
• Participate in code reviews and provide constructive feedback to team members
• Continuously optimize and improve data processing pipeline to increase efficiency and reduce processing time
• Assist in the integration of data from various sources into our data lake
• Document and communicate technical solutions and processes to team members and stakeholders
• Contribute to the development of data governance and security policies and procedures

Qualifications:

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field
• 1-2 years of experience in software development, preferably with a focus on big data and Spark
• Strong understanding of Apache Spark and its ecosystem (Spark SQL, Spark Streaming, Spark MLlib, etc.)
• Experience with programming languages such as Java, Scala, or Python
• Familiarity with distributed computing and parallel processing
• Knowledge of relational and NoSQL databases
• Excellent problem-solving and analytical skills
• Ability to work independently and in a team environment
• Excellent communication and interpersonal skills
• Willingness to learn and adapt to new technologies and tools
• Experience with cloud platforms such as AWS, Azure, or Google Cloud is a plus

Working at our company: We are a fast-growing company that values innovation, collaboration, and continuous learning. As part of our team, you will have the opportunity to work on challenging and impactful projects, while being supported by a diverse and talented group of individuals. We offer a competitive salary, comprehensive benefits package, and a flexible work environment.

We look forward to hearing from you!