Key Responsibilities:

Design and develop highly scalable and efficient data pipelines to ingest, process, and store large volumes of data from various sources.
Collaborate with data scientists and analysts to understand their data requirements and provide them with the necessary tools and infrastructure to perform their analysis.
Continuously optimize and improve the performance of our big data infrastructure to support the growing needs of the company.
Troubleshoot and resolve any issues with data processing, storage, or accessibility, ensuring high data quality and integrity.
Develop and maintain automated data quality checks and data governance processes to ensure data accuracy and consistency.
Stay updated with the latest big data technologies and trends, and make recommendations for their implementation to enhance our data processing capabilities.
Document all data processes and procedures for future reference and ensure compliance with data privacy and security regulations.

Qualifications:

Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
Minimum of 5 years of experience in big data engineering or a similar role.
Strong experience with big data technologies such as Hadoop, Spark, Kafka, HBase, Hive, etc.
Proficient in programming languages like Python, Java, or Scala.
Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
Experience with data modeling, data warehousing, and ETL processes.
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills.
Able to work in a fast-paced environment and handle multiple projects simultaneously.

Apply now!.

Hashtags