Key Responsibilities:

Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications
Design and develop scalable and efficient data pipelines using Apache Spark and other Big Data technologies
Develop and maintain ETL processes to process large volumes of data in batch and real-time
Troubleshoot and resolve issues related to data processing, data quality, and performance
Optimize Spark jobs for better performance and scalability
Work closely with data scientists to implement machine learning models in Spark
Develop and maintain data models and data structures to support data processing and analytics
Participate in code reviews and provide constructive feedback to team members
Stay updated with the latest trends and advancements in Big Data technologies and contribute to the continuous improvement of our data architecture

Qualifications:

Bachelor's or Master's degree in Computer Science, Information Technology, or a related field
Minimum of 3 years of experience in developing data processing solutions using Apache Spark
Strong experience in programming languages such as Scala, Java, or Python
Experience working with Big Data technologies such as Hadoop, Hive, or Kafka
Knowledge of SQL and database design principles
Experience with data modeling and data warehousing concepts
Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud
Excellent problem-solving and analytical skills
Strong communication and collaboration skills
Ability to work in a fast-paced and agile environment
Experience in developing and deploying Spark applications in a production environment is a plus

We offer a competitive salary, comprehensive benefits package, and opportunities for career growth. Apply now and embark on an exciting career as a Spark Developer with Lobox.

Hashtags