Pyspark Developer

At Lobox, we value diversity and are committed to creating an inclusive and welcoming workplace for all employees

Position: Pyspark Developer

Location: San Francisco, California, United States

Employment Type: Full-time

Salary: $171000 - $208000

Lobox is seeking a highly skilled and experienced Pyspark Developer to join our dynamic team. As a Pyspark Developer, you will be responsible for designing, developing, and implementing data solutions using Pyspark and other Big Data technologies. You will work closely with our data scientists and data engineers to build efficient and scalable data pipelines to support our business needs.

Key Responsibilities:

• Designing and developing data pipelines using Pyspark to process large volumes of data
• Collaborating with data scientists to understand business requirements and translate them into technical solutions
• Building data processing and data storage solutions using various Big Data technologies such as Hadoop, Hive, and AWS
• Participating in code reviews and ensuring code quality and best practices are followed
• Troubleshooting and resolving any issues related to data pipelines and data processing
• Keeping up-to-date with the latest advancements in Big Data technologies and implementing them in our projects
• Working with cross-functional teams to ensure smooth integration of data solutions into our systems
• Documenting technical specifications and maintaining accurate project documentation
• Providing technical guidance and mentoring to junior team members as needed

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field
• Minimum of 3 years of experience working as a Pyspark Developer or in a similar role
• Strong experience with Pyspark, Python, and SQL
• Hands-on experience with Big Data technologies such as Hadoop, Hive, and AWS
• Knowledge of data warehousing concepts and data modeling
• Familiarity with Agile development methodologies
• Excellent problem-solving and analytical skills
• Strong communication and interpersonal skills
• Ability to work independently as well as in a team environment
• Proven track record of delivering high-quality projects within tight deadlines

We offer a competitive salary, comprehensive benefits package, and opportunities for career growth and development. If you are passionate about Big Data and have a strong background in Pyspark development, we encourage you to apply for this exciting opportunity. Join our team and be a part of shaping the future of data-driven solutions.