Pyspark Developer

If you are passionate about data and have a strong background in Pyspark and big data technologies, we would love to hear from you! Apply now and be a part of our innovative and success-driven team.

Position: Pyspark Developer

Location: New York, New York, United States

Salary: $100 Per hour

About the Role: We are seeking a highly skilled Pyspark Developer to join our dynamic team. As a Pyspark Developer, you will be responsible for developing and maintaining complex data pipelines and ETL processes using Pyspark. Your expertise in big data technologies and programming will be crucial in driving the success of our data-driven initiatives.

Key Responsibilities:

• Design, develop, and implement Pyspark based data processing solutions to support business objectives
• Collaborate with cross-functional teams to understand data requirements and develop scalable solutions
• Optimize data pipelines for performance and reliability, troubleshoot and resolve issues as needed
• Develop and maintain data quality and data governance processes
• Develop and maintain technical documentation for data pipelines and processes
• Keep up-to-date with emerging trends and technologies in big data and provide recommendations for improvement

Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field
• Minimum of 3 years of experience in data engineering with Pyspark and Python
• Strong knowledge of big data concepts and technologies such as Hadoop, Spark, Hive, and Kafka
• Experience with cloud data platforms such as AWS, Azure, or Google Cloud
• Proficient in SQL and database management
• Experience with agile methodologies and working in a fast-paced environment
• Excellent problem-solving skills and ability to work independently as well as in a team
• Strong communication and interpersonal skills

Why Join Us:

• As a Pyspark Developer, you will have the opportunity to work on cutting-edge technologies and drive impactful solutions that will shape our business. We offer a dynamic and collaborative work environment where your ideas and contributions are valued. We also provide competitive compensation packages, comprehensive benefits, and opportunities for growth and development.