Key Responsibilities:

Design, develop, and maintain data pipelines using Pyspark for large-scale data processing.
Collaborate with data engineers and data scientists to understand data requirements and implement efficient solutions.
Optimize existing data pipelines and workflows for improved performance and scalability.
Develop and maintain data quality checks to ensure the accuracy and integrity of data.
Troubleshoot and resolve data pipeline issues in a timely manner.
Stay updated with the latest advancements in Pyspark and other big data technologies to continuously improve our data processing systems.

Qualifications:

Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
Minimum of 3 years of experience in Pyspark development.
Strong understanding of distributed computing principles and big data technologies.
Experience with SQL and NoSQL databases.
Familiarity with data warehousing concepts and tools such as Hive, Hadoop, and Spark.
Excellent problem-solving and analytical skills.
Ability to work independently and in a team environment.
Excellent communication and interpersonal skills.

Why Lobox: At Lobox, we believe that our employees are our most valuable asset. We offer a competitive salary, comprehensive benefits package, and opportunities for career growth and development. Our company culture is collaborative, innovative, and inclusive, and we are committed to creating a diverse and inclusive workplace.

Apply now to join our talented team and be a part of our exciting journey!

Hashtags