Spark Developer

If you are a highly motivated and passionate Spark Developer looking for an exciting opportunity to work with a dynamic team, we want to hear from you

Job Title: Spark Developer

Location: New York, New York, United States

Salary: $100 Per hour

About the Role: We are seeking a highly skilled and experienced Spark Developer to join our dynamic team. As a Spark Developer, you will be responsible for designing, developing, and maintaining complex data processing pipelines using Apache Spark. You will work closely with our data engineering and data science teams to build scalable and efficient data solutions that will drive business growth and insights.

Key Responsibilities:

• Design and develop data processing pipelines using Apache Spark for large-scale data sets.
• Collaborate with data engineers and data scientists to understand data requirements and implement efficient data solutions.
• Develop and maintain data ingestion processes, data cleaning and preparation methods, and data transformation processes.
• Write efficient and optimized Spark code to handle large volumes of data.
• Monitor, troubleshoot, and optimize Spark jobs for performance and scalability.
• Create and maintain technical documentation for Spark processes and workflows.
• Keep up-to-date with the latest developments in Spark and recommend improvements or new tools to enhance data processing capabilities.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Minimum of 3 years of experience working as a Spark Developer on large-scale data processing projects.
• Strong experience with Apache Spark, including Spark Core, Spark SQL, and Spark Streaming.
• Proficient in programming languages such as Scala, Java, or Python.
• Solid understanding of distributed computing principles and practical experience with distributed systems.
• Experience with cloud platforms such as AWS, GCP, or Azure.
• Knowledge of database technologies such as SQL, NoSQL, and Hadoop.
• Familiarity with Agile methodologies and experience working in an Agile environment.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills to work effectively in a team environment.

Why Work with Us:

• Competitive salary and benefits package.
• Opportunity to work with cutting-edge technologies and solve complex data challenges.
• Collaborative and inclusive work culture that values diversity and innovation.
• Professional development and growth opportunities.
• Flexible work arrangements and work-life balance.

Apply now and be a part of our journey to harness the full potential of data through our innovative data solutions.