Pyspark Developer

If you are a self-driven and passionate Pyspark Developer with a strong desire to work on challenging projects, we would love to hear from you

Position: Pyspark Developer

Location: San Francisco, California, United States

Salary: $171000 - $208000

Company Overview: We are a leading technology company that specializes in data analytics and machine learning solutions. Our cutting-edge products and services help businesses of all sizes make data-driven decisions and achieve their goals. We are seeking a highly skilled Pyspark Developer to join our dynamic team and contribute to the development of our innovative products.

Position Overview: As a Pyspark Developer, you will be responsible for designing, developing, and maintaining our Pyspark-based applications. You will work closely with our data analytics and machine learning teams to build scalable and efficient data pipelines and machine learning models. Your role will also involve troubleshooting and optimizing existing Pyspark code to improve performance and functionality.

Key Responsibilities:

• Design, develop and maintain Pyspark-based applications
• Collaborate with data analysts and data scientists to understand business requirements and translate them into technical solutions
• Build and maintain scalable and efficient data pipelines using Pyspark
• Develop and implement machine learning models using Pyspark
• Troubleshoot and optimize existing Pyspark code to improve performance and functionality
• Participate in code reviews and provide constructive feedback to team members
• Stay up-to-date with the latest developments and advancements in Pyspark and related technologies
• Continuously identify and implement process improvements to enhance the efficiency and effectiveness of our Pyspark-based applications

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• Minimum of 3 years of experience in Pyspark development
• Strong understanding of Apache Spark architecture and Pyspark API
• Experience in building and maintaining data pipelines and ETL processes using Pyspark
• Hands-on experience in developing and implementing machine learning models using Pyspark
• Proficiency in SQL and database management
• Knowledge of data warehousing concepts and techniques
• Demonstrated ability to troubleshoot and optimize Pyspark code for performance and functionality
• Excellent problem-solving skills and attention to detail
• Strong communication and collaboration skills
• Ability to work independently and in a team environment
• Passion for learning and staying up-to-date with new technologies and best practices in Pyspark development

Why Join Us:

• Opportunity to work with a highly talented and motivated team
• Competitive salary and benefits package
• Professional growth and development opportunities
• Cutting-edge technology stack and tools
• Open and collaborative work environment
• Flexible work hours and remote work options

Apply now and join our mission to revolutionize the way businesses use data to drive their success.