Key Responsibilities:

Design and implement scalable and reliable data processing systems using technologies such as Hadoop, Spark, and Kafka
Develop and maintain data pipelines for real-time and batch processing of large datasets
Optimize data storage and retrieval processes for efficient and cost-effective data management
Collaborate with data scientists and analysts to understand data needs and ensure data quality and accuracy
Troubleshoot and resolve issues related to data processing and performance
Stay updated with the latest technologies and tools in the Big Data space and make recommendations for their implementation
Develop and maintain documentation for data infrastructure and processes
Work with cross-functional teams to identify and implement solutions for business needs and requirements
Mentor and train junior members of the team on Big Data technologies and best practices

Qualifications:

Bachelor's or Master's degree in Computer Science, Engineering, or a related field
Minimum of 3 years of experience working as a Big Data Engineer
Strong programming skills in languages such as Python, Java, or Scala
Hands-on experience with Big Data technologies such as Hadoop, Spark, Kafka, and NoSQL databases
Experience with data modeling, data warehousing, and ETL processes
Knowledge of cloud computing platforms such as AWS, Azure, or Google Cloud
Familiarity with data visualization tools such as Tableau or Power BI
Excellent problem-solving and analytical skills
Strong communication and collaboration skills
Ability to work in a fast-paced and dynamic environment
Proven track record of delivering high-quality and scalable data solutions

Join our team and be a part of our mission to leverage big data for driving business success.

Hashtags