Key Responsibilities:

Design and implement data architectures that support large-scale processing of structured and unstructured data.
Develop and maintain data pipelines to extract, transform, and load data from various sources into our data warehouse.
Collaborate with data scientists and analysts to understand data requirements and develop solutions that meet their needs.
Ensure data quality and integrity by implementing data validation and monitoring processes.
Optimize and tune data processing systems for maximum performance and scalability.
Troubleshoot and resolve issues related to data processing and storage.
Stay updated with the latest trends and technologies in the field of big data and data engineering and incorporate them into our data infrastructure.
Collaborate with cross-functional teams to develop and deliver innovative solutions that leverage big data.
Document data pipelines and processes to ensure that they are well understood and well maintained.

Qualifications:

Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
Minimum of 5 years of experience working as a Big Data Engineer or a similar role.
Strong experience with big data technologies such as Hadoop, Spark, Kafka, and NoSQL databases.
Proficiency in programming languages such as Java, Python, or Scala.
Familiarity with data warehousing concepts and tools such as Redshift, Snowflake, or Google BigQuery.
Experience with data processing frameworks such as Apache Airflow, Luigi, or Oozie.
Strong understanding of data modeling, data structures, and algorithms.
Solid knowledge of SQL and database management.
Excellent problem-solving skills and ability to troubleshoot complex data issues.
Proven experience in designing and building large-scale data processing systems.
Excellent communication and collaboration skills.
Ability to work in a fast-paced and dynamic environment.

Join us and be a part of a team that is dedicated to leveraging big data to drive business growth and success.

Hashtags