Key Responsibilities:

Develop and maintain efficient data processing pipelines using Pyspark, Scala, and other Big Data technologies
Design and implement data ingestion processes from various sources, including structured and unstructured data
Collaborate with cross-functional teams to understand data requirements and develop solutions to meet business needs
Optimize and tune data processing jobs for performance and scalability
Troubleshoot and resolve issues with data pipelines and ensure data quality and integrity
Develop and maintain technical documentation for all data processes and solutions
Stay up-to-date with industry trends and advancements in Big Data technologies to continuously improve our data processing capabilities

Qualifications:

Bachelor's or Master's degree in Computer Science, Information Systems, or a related field
Minimum of 3 years of experience in developing data processing solutions using Pyspark
Strong proficiency in programming languages such as Python and Scala
Experience with Big Data technologies such as Hadoop, Spark, Kafka, etc.
Knowledge of data warehousing concepts and SQL
Experience with cloud computing platforms, especially AWS, is a plus
Ability to work in a fast-paced and collaborative environment
Excellent problem-solving and analytical skills
Strong communication and teamwork abilities

If you are a passionate and driven Pyspark Developer looking for an exciting opportunity to work with cutting-edge technologies, we would love to hear from you. Apply now and join our team of talented professionals!

Hashtags