Pyspark Developer

If you are passionate about data and have a strong background in Pyspark, we would love to hear from you! Join our team and be a part of our exciting journey to revolutionize the data industry

Position: Pyspark Developer

Location: San Francisco, California, United States

Salary: $171000 - $208000

Company Overview: We are a fast-growing technology company that specializes in providing cutting-edge data solutions for our clients. Our team is composed of highly skilled professionals who are dedicated to staying at the forefront of the industry. We are currently seeking a talented Pyspark Developer to join our team and help us continue to deliver innovative solutions to our clients.

Job Overview: As a Pyspark Developer, you will be responsible for designing, developing, and maintaining our data processing pipelines. Your main focus will be on developing scalable and efficient data processing workflows using Pyspark. You will also work closely with our data scientists and data analysts to understand their requirements and translate them into technical solutions.

Key Responsibilities:

• Design, develop, and maintain data processing pipelines using Pyspark
• Optimize data processing workflows for performance and scalability
• Collaborate with data scientists and data analysts to understand their requirements and translate them into technical solutions
• Troubleshoot and resolve technical issues related to data processing
• Develop and maintain technical documentation for data processing pipelines
• Stay up-to-date with the latest advancements in Pyspark and other big data technologies
• Provide technical guidance and mentorship to junior team members

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or related field
• Minimum of 3 years of experience working with Pyspark in a professional setting
• Strong understanding of big data concepts and technologies
• Experience with data modeling and database design
• Proficiency in programming languages such as Python and SQL
• Experience with cloud-based data processing platforms such as AWS or Azure
• Excellent problem-solving and analytical skills
• Strong communication and collaboration skills
• Ability to work effectively in a fast-paced and dynamic environment

Why Work With Us:

• Opportunity to work with cutting-edge technologies and solutions
• Collaborative and inclusive work culture
• Competitive salary and benefits package
• Career growth and development opportunities
• Work-life balance and flexible work arrangements

Apply now!