Pyspark Developer

We offer competitive salary packages, comprehensive benefits, and a collaborative and innovative work environment

Job Title: Pyspark Developer

Location: New York, New York, United States

Salary: $100 Per hour

Job Summary: We are seeking a highly skilled Pyspark Developer to join our dynamic team. As a Pyspark Developer, you will be responsible for developing and maintaining data pipelines and ETL processes using the Pyspark framework. You will work closely with our data scientists and data engineers to design, build, and optimize data solutions that support our business needs. The ideal candidate will have a strong background in data engineering, with a deep understanding of Pyspark, SQL, and data warehousing concepts.

Key Responsibilities:

• Design, develop, and maintain data pipelines and ETL processes using Pyspark
• Collaborate with data scientists and data engineers to understand business requirements and design efficient data solutions
• Optimize data pipelines for performance and scalability
• Develop and maintain data quality checks to ensure accuracy and completeness of data
• Troubleshoot and resolve data-related issues in a timely manner
• Monitor and maintain data pipelines to ensure data availability and reliability
• Document data processes and procedures for future reference
• Stay up-to-date with industry trends and advancements in data engineering and contribute to the continuous improvement of our data processes

Qualifications:

• Bachelor's or Master's degree in Computer Science, Data Science, or a related field
• Minimum of 3 years of experience as a Pyspark Developer or in a similar role
• Strong proficiency in Pyspark, SQL, and data warehousing concepts
• Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud
• Knowledge of programming languages such as Python, Java, or Scala
• Experience with data visualization tools such as Tableau, Power BI, or Qlik
• Excellent problem-solving and analytical skills
• Great communication and teamwork abilities
• Ability to work in a fast-paced and dynamic environment
• Strong attention to detail and a passion for data and analytics

Join our team of talented individuals and make a significant impact on our data-driven organization. Apply now and become a part of our journey towards success!