Pyspark Developer

If you are a self-motivated and skilled Pyspark Developer looking to join a dynamic and innovative team, we encourage you to apply for this opportunity

Position: Pyspark Developer

Location: New York, New York, United States

Salary: $100 Per hour

Company Overview: We are a leading technology company that provides innovative solutions to businesses across various industries. Our team is made up of highly skilled professionals who are passionate about using cutting-edge technologies to drive business growth and success. We are currently seeking a talented Pyspark Developer to join our growing team.

Job Description: As a Pyspark Developer, you will be responsible for designing, developing, and maintaining data pipelines and ETL processes using Pyspark. You will work closely with our data engineering and data science teams to ensure the efficient and accurate processing of large datasets. Your role will be crucial in enabling our company to effectively manage and utilize our data assets.

Key Responsibilities:

• Develop and maintain data pipelines and ETL processes using Pyspark
• Design and implement data storage solutions that meet business requirements
• Collaborate with data engineering and data science teams to optimize data processing and analysis
• Troubleshoot and resolve data-related issues in a timely manner
• Ensure data quality and accuracy through data validation and testing
• Implement best practices for data governance and security
• Stay updated on the latest trends and advancements in Pyspark and other big data technologies
• Participate in code reviews and provide feedback to improve code quality and efficiency
• Communicate effectively with cross-functional teams and stakeholders to understand business needs and requirements
• Continuously improve and optimize existing data processes and systems

Qualifications:

• Bachelor's degree in Computer Science, Information Systems, or a related field
• Minimum of 3 years of experience in Pyspark development
• Strong understanding of big data concepts and distributed computing
• Proficiency in Python and SQL
• Experience with data warehousing and ETL processes
• Familiarity with cloud technologies such as AWS, Azure, or GCP
• Excellent problem-solving and analytical skills
• Ability to work independently and in a team environment
• Strong communication and interpersonal skills
• Proven track record of delivering high-quality code and meeting project timelines

We Offer:

• Competitive salary and benefits package
• Opportunities for professional growth and development
• Collaborative and inclusive work environment
• Exciting and challenging projects
• Cutting-edge technologies and tools
• Flexible work arrangements
• Company-sponsored events and team activities

We are committed to creating a diverse and inclusive workplace and welcome applicants from all backgrounds. Join us and be a part of our success story!