If you are passionate about big data and have a strong background in Pyspark development, we would love to hear from you! Join our team and be a part of our mission to revolutionize the way data is processed and analyzed
Position: Pyspark Developer
Location: San Francisco, California, United States
Salary: $171000 - $208000
Overview: We are seeking a highly skilled Pyspark Developer to join our dynamic team. The ideal candidate will have a strong background in programming and data analysis, as well as experience with Pyspark and other big data technologies. This is a challenging and rewarding role that offers the opportunity to work on cutting-edge projects and contribute to the development of innovative solutions.
Key Responsibilities:
- Develop and maintain Pyspark applications and pipelines to process large volumes of data
- Collaborate with data scientists and engineers to implement machine learning models and algorithms
- Design, build, and optimize data infrastructure to support data processing and analysis
- Troubleshoot and resolve technical issues related to Pyspark and big data technologies
- Monitor and improve performance of Pyspark jobs and processes
- Participate in code reviews and quality assurance to ensure high-quality, scalable, and maintainable code
- Stay up-to-date with industry trends and best practices in big data processing and analytics
Qualifications:
- Bachelor's degree in Computer Science, Software Engineering, or a related field
- Minimum of 3 years of experience in software development and data analytics
- Strong proficiency in Pyspark and related big data technologies such as Hadoop, Spark, and Kafka
- Experience with machine learning and data science tools and libraries such as Pandas, Numpy, and Scikit-learn
- Proficiency in programming languages such as Python, Java, or Scala
- Knowledge of SQL and relational databases
- Familiarity with cloud computing platforms such as AWS, Azure, or Google Cloud
- Excellent problem-solving and analytical skills
- Strong communication and teamwork abilities
- Proven ability to work in a fast-paced and dynamic environment
- Experience with Agile methodologies is a plus
Why Work With Us:
- Opportunity to work with cutting-edge technologies and contribute to innovative projects
- Competitive salary and benefits package
- Collaborative and inclusive work environment
- Career growth and development opportunities
- Flexible working hours and remote work options
- Fun and engaging company culture
Apply now and take the next step in your career as a Pyspark Developer.