Key Responsibilities:

Design and develop Pyspark-based solutions for large-scale data processing and analysis
Collaborate with data scientists and engineers to understand data requirements and design optimal solutions
Develop and maintain data pipelines to extract, transform, and load data from various sources
Optimize Pyspark code for performance and scalability
Troubleshoot and resolve issues related to data processing and pipeline failures
Develop and maintain unit tests for Pyspark code
Write clear and concise technical documentation for developed solutions
Stay updated with the latest developments in the Pyspark ecosystem and propose new solutions to improve data processing efficiency

Requirements:

Bachelor's degree in Computer Science, Engineering, or a related field
Minimum of 3 years of experience in software development, with at least 2 years of experience in Pyspark
Strong proficiency in Python programming language
Experience with big data technologies such as Hadoop, Spark, and Kafka
Strong understanding of data structures, algorithms, and data processing concepts
Experience with data visualization tools like Tableau or Power BI is a plus
Excellent problem-solving and debugging skills
Strong communication and collaboration skills
Ability to work in a fast-paced and dynamic environment

Why Work With Us: We are a fast-growing company with a diverse and inclusive work culture. We offer competitive compensation, flexible work hours, and opportunities for career growth and development. Our team is made up of passionate individuals who are dedicated to making a positive impact in the world of data analytics. Join us and be a part of our journey towards success!

Apply now and become a valuable member of our team as a Pyspark Developer.

Hashtags