Key Responsibilities:

Designing, building, and maintaining scalable big data pipelines for data ingestion, processing, and analysis.
Collaborating with data scientists and analysts to understand their data requirements and translate them into technical specifications.
Identifying and implementing new technologies and tools to optimize data processing and analysis.
Troubleshooting and resolving any issues related to data processing and performance.
Ensuring data quality and reliability through data validation and testing.
Building and maintaining data warehouses and data lakes for storage and retrieval of large datasets.
Writing complex SQL queries and optimizing their performance to support data analysis and reporting.
Developing and maintaining data governance policies and procedures to ensure data privacy and security.
Providing technical guidance and support to other teams on big data technologies and best practices.

Qualifications:

Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Minimum of 3 years of experience in designing and building big data pipelines using tools such as Hadoop, Spark, Kafka, etc.
Strong proficiency in programming languages such as Java, Python, or Scala.
Extensive experience with SQL and database systems such as MySQL, Oracle, or PostgreSQL.
Deep understanding of big data concepts and technologies, data modeling, and data warehousing.
Experience with cloud computing platforms such as AWS, Azure, or Google Cloud.
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills.
Ability to work in a fast-paced and dynamic environment.

If you have a passion for big data and want to be part of a cutting-edge team, apply now!.

Hashtags