Key Responsibilities:

Lead the design and implementation of large-scale data solutions using Spark technology
Collaborate with data engineers, data scientists, and business stakeholders to gather requirements and understand business needs
Design and develop data models, ETL processes, and data pipelines using Spark
Optimize and tune Spark applications for performance and scalability
Develop and maintain data quality and data governance processes
Provide technical guidance and mentorship to junior team members
Stay up-to-date with the latest Spark developments and identify opportunities to incorporate new features and technologies into existing solutions
Troubleshoot and resolve complex technical issues related to Spark applications
Act as a subject matter expert on Spark technology and provide recommendations for best practices and standards
Collaborate with DevOps teams to ensure proper deployment and monitoring of Spark applications

Qualifications:

Bachelor's or Master's degree in Computer Science, Engineering, or a related field
Minimum of 8 years of experience in software development with at least 3 years of experience in designing and implementing data solutions using Spark
Strong experience in Spark programming using Scala or Java
Experience with distributed computing and big data technologies such as Hadoop, Hive, and Kafka
Proficiency in SQL and database concepts
Experience with cloud platforms such as AWS, Azure, or Google Cloud
Knowledge of data warehousing and data modeling concepts
Excellent problem-solving and analytical skills
Strong communication and collaboration skills
Ability to work in a fast-paced and agile environment
Experience in leading and mentoring a team is preferred

Apply now and join our team of talented professionals in shaping the future of data-driven businesses.

Hashtags