If you are passionate about data and have a strong background in Pyspark, we would love to hear from you
Position: Pyspark Developer
Location: New York, New York, United States
Salary: $171000 - $208000
Employment Type: Full-time
About the Company: Lobox is a leading software development company that specializes in providing cutting-edge solutions to businesses across various industries. Our team of innovative and dedicated professionals is committed to delivering high-quality products and services to our clients. We are currently looking for a talented Pyspark Developer to join our dynamic team.
Job Overview: As a Pyspark Developer, you will be responsible for designing, developing, and maintaining applications using Pyspark. You will work closely with our data science team to build robust and scalable data processing pipelines. You will also collaborate with other developers and stakeholders to ensure the timely delivery of projects and the overall success of our data-driven initiatives.
Key Responsibilities:
- Design and develop Pyspark applications for data processing and analysis.
- Collaborate with data scientists to understand business requirements and translate them into technical solutions.
- Build and maintain data processing pipelines using Pyspark and other Big Data technologies.
- Troubleshoot and debug code to ensure the smooth functioning of applications.
- Optimize and improve existing data pipelines for better performance and scalability.
- Integrate external data sources and APIs into existing applications.
- Work with cross-functional teams to ensure the timely delivery of projects.
- Keep up-to-date with the latest advancements in Pyspark and Big Data technologies and implement them in projects where applicable.
- Mentor and guide junior developers, providing technical expertise and support.
Requirements:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Minimum of 3 years of experience as a Pyspark Developer.
- Strong proficiency in Pyspark and other Big Data technologies such as Hadoop, Spark, and Kafka.
- Experience with data processing and analysis using SQL.
- Strong understanding of data structures, algorithms, and software design principles.
- Familiarity with Agile development methodologies.
- Excellent problem-solving skills and attention to detail.
- Ability to work independently and as part of a team.
- Strong communication and interpersonal skills.
Why Join Us?
At Lobox, we value our employees and strive to create a positive and inclusive work environment. As a Pyspark Developer, you will have the opportunity to work on challenging projects and collaborate with a team of talented professionals. We offer competitive salaries, benefits, and opportunities for career growth and development.
Apply now and become a part of our dynamic team!