Pyspark Developer

If you are passionate about data, have a strong background in Pyspark, and are looking for an exciting opportunity to grow your career, we encourage you to apply for this role

Job Title: Pyspark Developer

Location: New York, New York, United States

Salary: $100 Per hour

Overview: We are seeking a highly skilled and experienced Pyspark Developer to join our dynamic team. As a Pyspark Developer, you will be responsible for designing, developing, and implementing data pipelines using Pyspark to support our data-driven applications. You will work closely with our data scientists, data engineers, and other cross-functional teams to ensure the timely delivery of high-quality data solutions that meet our business needs.

Key Responsibilities:

• Design, develop, and maintain data pipelines using Pyspark for our data-driven applications.
• Collaborate with data scientists and data engineers to understand business requirements and translate them into technical specifications.
• Optimize and tune Pyspark jobs to ensure efficient and scalable data processing.
• Develop and maintain data quality checks and monitor data pipeline performance.
• Troubleshoot and resolve technical issues related to Pyspark jobs, data pipelines, and data ingestion.
• Collaborate with cross-functional teams to identify and implement process improvements.
• Keep up-to-date with industry best practices and emerging technologies in data processing and analytics.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• Minimum of 3 years of experience as a Pyspark Developer or a similar role.
• Extensive experience with Pyspark, including writing complex ETL jobs and working with large datasets.
• Proficient in SQL, Python, and other programming languages.
• Experience with big data technologies such as Hadoop, Spark, and Hive.
• Solid understanding of data warehousing concepts and data modeling.
• Strong problem-solving and analytical skills.
• Excellent communication and teamwork skills.

Benefits:

• Prescription drug coverage
• Competitive salary and benefits package.
• Opportunity to work with cutting-edge technologies and solve complex data challenges.
• Collaborative and inclusive work environment.
• Professional development and growth opportunities.
• Flexible work arrangements.
• Health insurance, retirement plans, and other benefits.

About our Company: We are a leading company in the data analytics industry, providing innovative solutions to our clients. Our team consists of talented individuals from diverse backgrounds, working together to solve complex data problems and drive business success. We value diversity, inclusion, and collaboration, and we are committed to providing our employees with a supportive and rewarding work environment.

We look forward to hearing from you!