Job details
Job details
Pyspark Developer
Lobox
Information Technology & Services
South San Francisco, CA, United States
0Applicants0Views10Skills3 months agoCreated
Pyspark Developer
Lobox
Information Technology & Services
South San Francisco, CA, United States
0Applicants0Views10Skills3 months agoCreated
Overview
Category
Information Technology & Services
Workplace
Remote
Job type
Contract
Experience level
Middle level
Tax term
Information Technology & Services
Location
South San Francisco, CA, United States
Details
If you are a Pyspark Developer looking for a new and exciting opportunity, we would love to hear from you
Position: Pyspark Developer
Location: San Francisco, California, United States
Salary: $100 Per hour
Job Type: Contract
About the Role: We are seeking a highly skilled Pyspark Developer to join our dynamic team. As a Pyspark Developer, you will be responsible for designing, developing, and implementing data pipelines and data processing solutions using Pyspark. You will work closely with our data scientists and data engineers to ensure efficient and accurate data processing for our organization.
Key Responsibilities:
- Design, develop, and maintain data pipelines using Pyspark for ingestion, processing, and extraction of data from various sources
- Collaborate with data scientists and data engineers to understand data requirements and implement efficient data solutions
- Develop efficient and scalable code to process and analyze large volumes of data
- Perform data quality checks and implement data cleansing and transformation techniques
- Troubleshoot and resolve any issues related to data processing and pipelines
- Optimize data processing workflows to improve performance and efficiency
- Develop and maintain technical documentation for all data pipelines and processes
- Stay updated with the latest trends and advancements in Pyspark and big data technologies
- Mentor and provide technical guidance to junior team members
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field
- Minimum of 3 years of experience working with Pyspark and big data technologies
- Strong experience in designing and implementing data pipelines using Pyspark
- Experience working with data warehousing and ETL tools
- Proficient in SQL and other programming languages such as Python or Java
- Strong understanding of data structures, algorithms, and software design principles
- Experience with cloud platforms such as AWS, Azure, or Google Cloud
- Ability to work in a fast-paced, dynamic environment and handle multiple projects simultaneously
- Excellent problem-solving and analytical skills
- Strong communication and collaboration skills
Why Join Our Team:
- Opportunity to work with cutting-edge technologies and contribute to the development of innovative data solutions
- Collaborative and inclusive work culture that values diversity and promotes personal growth and development
- Competitive salary and benefits package
- Flexible work hours and work from home options
- Regular training and professional development opportunities
- Opportunity to work on challenging and interesting projects with a talented and passionate team
Apply now and join our team of data enthusiasts!
Hashtags
#pysparkdeveloper
#sanfrancisco
#pyspark
#developer