If you are passionate about big data and have a strong background in Spark, we would love to hear from you
Job Title: Spark Engineer
Location: New York, New York, United States
Salary: $107 Per hour
Position Overview: We are seeking a highly skilled and experienced Spark Engineer to join our dynamic team. As a Spark Engineer, you will be responsible for designing, developing, and maintaining our Spark-based data processing system. You will work closely with our data scientists and data analysts to ensure the efficient and reliable processing of large amounts of data. The ideal candidate will have a strong background in Spark, distributed systems, and data engineering.
Key Responsibilities:
- Design, implement, and maintain our Spark-based data processing system
- Collaborate with data scientists and data analysts to understand business requirements and translate them into technical solutions
- Optimize data processing jobs for performance and scalability
- Troubleshoot and resolve any issues related to data processing
- Develop and maintain data pipeline monitoring and alerting systems
- Work with cross-functional teams to ensure data quality and consistency
- Stay up-to-date with the latest Spark and big data technologies and trends
- Mentor and provide technical guidance to junior team members
Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- Minimum of 3 years of experience working with Spark and distributed systems
- Strong programming skills in Java, Scala, or Python
- Experience with data warehousing and ETL processes
- Familiarity with cloud computing platforms such as AWS or Azure
- Knowledge of SQL and relational databases
- Excellent problem-solving and analytical skills
- Ability to work in a fast-paced and constantly evolving environment
- Strong communication and collaboration skills
- Experience with machine learning and data science is a plus
Why Join Us:
- Opportunity to work with cutting-edge technologies and be part of a highly skilled team
- Competitive salary and benefits package
- Flexible working hours and work-from-home options
- Collaborative and inclusive work culture
- Continuous learning and development opportunities
- Opportunity for growth and career advancement
Join us and be part of a team that is revolutionizing the way data is processed and analyzed.