Key Responsibilities:

Design and implement scalable, reliable, and efficient data pipelines to collect, process, and store large volumes of data from various sources, including structured and unstructured data.
Develop and maintain data processing systems, including data warehouses, data lakes, and data marts, to support data analytics and business intelligence initiatives.
Collaborate with data scientists and analysts to understand business requirements, identify data needs, and design data models to support business use cases.
Optimize and tune data pipelines and data processing systems to ensure high performance, scalability, and availability.
Monitor and troubleshoot data pipelines and data processing systems to identify and resolve data quality issues, performance bottlenecks, and system failures.
Implement and maintain data security and privacy measures to ensure the confidentiality, integrity, and availability of data.
Keep up-to-date with emerging big data technologies, tools, and frameworks, and evaluate their potential to improve our data infrastructure and processes.
Participate in code reviews, and provide technical guidance and mentorship to junior team members.

Qualifications:

Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Minimum of 3 years of experience as a Big Data Engineer, Data Engineer, or a similar role.
Strong experience in designing and developing big data solutions, including data pipelines, data warehouses, and data lakes, using big data technologies such as Hadoop, Spark, Kafka, and Hive.
Proficiency in programming languages used in big data environments, such as Java, Scala, Python, and SQL.
Experience in working with cloud-based big data platforms, such as AWS, Azure, or Google Cloud Platform.
Knowledge of data modeling, database design, and data warehousing concepts.
Experience in implementing data security and privacy controls, such as encryption, access controls, and data masking.
Excellent problem-solving, analytical, and troubleshooting skills.
Strong communication and collaboration skills.

If you are passionate about big data and want to be part of a team that is revolutionizing the way we use data, we encourage you to apply for this exciting opportunity.

Hashtags