Key Responsibilities:

Design and develop efficient and scalable Pyspark applications to process and analyze large datasets.
Work closely with data scientists and data engineers to understand business requirements and develop solutions to meet them.
Write well-structured, efficient, and maintainable code following industry best practices.
Troubleshoot and debug issues in existing Pyspark applications and provide timely resolutions.
Optimize Pyspark jobs for performance by tuning configurations, data partitioning, and caching.
Collaborate with cross-functional teams to integrate Pyspark applications with other systems and tools.
Stay updated with the latest advancements in the Pyspark ecosystem and implement them in the existing applications.
Document technical specifications, design decisions, and code changes for future reference.
Mentor and guide junior developers on Pyspark best practices and standards.

Qualifications:

Bachelor's or Master's degree in Computer Science, Information Systems, or related field.
Minimum of 3 years of experience in developing applications using Pyspark.
Strong understanding of distributed computing principles and Pyspark architecture.
Proficient in Python programming language and experience with Java is a plus.
Experience with Hadoop ecosystem and cloud platforms such as AWS, Azure, or GCP.
Hands-on experience with SQL and NoSQL databases.
Experience with data processing frameworks like Apache Spark, Kafka, or Flink is a plus.
Familiarity with data visualization tools like Tableau, Power BI, or QlikView is a plus.
Excellent problem-solving skills and ability to work in a fast-paced and collaborative environment.
Strong communication and interpersonal skills to effectively communicate with technical and non-technical stakeholders.

We offer a competitive salary, benefits package, and opportunities for professional growth and development. Apply now and take the next step in your career as a Pyspark Developer.

Hashtags