Job details
Job details
Pyspark Developer
Lobox
Information Technology & Services
South San Francisco, CA, United States
1Applicants1Views8Skills3 months agoCreated
Pyspark Developer
Lobox
Information Technology & Services
South San Francisco, CA, United States
1Applicants1Views8Skills3 months agoCreated
Overview
Category
Information Technology & Services
Workplace
Remote
Job type
Contract
Experience level
Senior level
Tax term
Information Technology & Services
Location
South San Francisco, CA, United States
Details
We are looking for a self-motivated and results-driven individual who is passionate about Big Data and has a strong desire to learn and grow in a challenging and dynamic environment
Job Title: Pyspark Developer
Location: San Francisco, California, United States
Salary: $100 Per hour
We are searching for a highly skilled and experienced Pyspark Developer to join our dynamic team. As a Pyspark Developer, you will be responsible for developing and maintaining complex data pipelines using Pyspark and other Big Data technologies.
Key Responsibilities:
- Design, develop and implement efficient and scalable data solutions using Pyspark
- Collaborate with data engineers and data scientists to understand business requirements and design data pipelines accordingly
- Develop data ingestion processes and ETL workflows to extract, transform and load data from various sources into the data warehouse
- Optimize data pipelines for performance and scalability to handle large volumes of data
- Troubleshoot and resolve any issues with data pipelines in a timely manner
- Stay updated with the latest technologies and tools related to Big Data and continuously improve data processes and pipelines
- Develop and maintain technical documentation for data pipelines and processes
Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering or a related field
- Minimum of 3 years of experience working with Pyspark and other Big Data technologies such as Hadoop, Spark, Hive, etc.
- Strong understanding of data warehousing concepts and experience with ETL tools and processes
- Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud
- Knowledge of programming languages such as Python, Scala or Java
- Experience with SQL and relational databases
- Experience with data visualization tools such as Tableau, Qlikview, Power BI, etc.
- Excellent problem-solving skills and ability to work in a fast-paced environment
- Strong communication and collaboration skills to work effectively with cross-functional teams
If you have a strong background in Pyspark and are looking for an exciting opportunity to apply your skills and expertise, then we want to hear from you! Join our team and be a part of our journey to harness the power of data and drive business success.
Hashtags
#pysparkdeveloper
#sanfrancisco
#pyspark
#developer