Key Responsibilities:

Design and develop Spark-based data processing pipelines to support our business needs.
Optimize and tune existing Spark jobs for performance and scalability.
Develop and maintain data ingestion processes from various data sources.
Collaborate with data scientists to implement machine learning algorithms and models in Spark.
Work closely with data analysts to ensure data quality and accuracy.
Monitor and troubleshoot production Spark jobs to identify and resolve issues.
Stay updated with industry trends and best practices in Spark and big data technologies.

Qualifications:

Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
Minimum of 3 years of experience working with Spark in a production environment.
Strong programming skills in Java, Scala, or Python.
Experience with data processing frameworks such as Hadoop, Hive, or Pig.
Familiarity with cloud-based platforms such as AWS, Azure, or Google Cloud.
Knowledge of SQL and database systems.
Experience with version control systems such as Git.
Excellent problem-solving and analytical skills.
Strong communication and teamwork abilities.

Preferred Qualifications:

Experience working with real-time data processing systems.
Familiarity with data warehousing concepts and tools.
Knowledge of distributed computing and parallel programming.
Experience with data visualization tools such as Tableau or Power BI.

We Offer:

Competitive salary and benefits package.
Opportunity to work with cutting-edge technologies.
Collaborative and inclusive work environment.
Career growth and development opportunities.

Join our team of talented data professionals and help us drive our business forward with innovative solutions. Apply now and take your career to the next level as a Spark Engineer.

Hashtags