GCP Big Data Engineer

Join our team and be part of a company that values innovation, collaboration, and continuous learning. As a GCP Big Data Engineer, you will have the opportunity to work on cutting-edge technologies and contribute to the success of our big data platform.

Job Title: GCP Big Data Engineer

Position Overview: We are seeking a highly skilled and experienced GCP Big Data Engineer to join our dynamic team. As a GCP Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data platform on Google Cloud Platform (GCP). You will play a pivotal role in leveraging big data technologies to drive business insights and support decision making. This is a challenging role that requires a strong understanding of GCP services, data warehousing, data modeling, and ETL processes.

Key Responsibilities:

• Design, develop and maintain our big data platform on GCP, ensuring scalability, availability, and performance.
• Collaborate with cross-functional teams to gather and understand business requirements, and translate them into technical solutions.
• Design and implement data models, schemas, and pipelines to ingest, process, and store large volumes of data.
• Develop and maintain ETL processes using GCP data processing tools such as Dataflow, Dataproc, and BigQuery.
• Monitor and troubleshoot data pipelines to ensure data quality and integrity.
• Optimize and tune the big data platform to improve performance and reduce costs.
• Develop and maintain documentation, runbooks, and operational procedures for the big data platform.
• Stay updated with the latest GCP services, features, and best practices, and share knowledge and expertise with the team.

Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Minimum of 3 years of experience as a Big Data Engineer, with at least 1 year of hands-on experience working with GCP services.
• Strong understanding of GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Storage.
• Experience with data warehousing and ETL processes, preferably using GCP technologies.
• Proficiency in SQL, Python, or Java for data manipulation and scripting.
• Knowledge of data modeling and schema design for big data platforms.
• Experience with CI/CD pipelines and automation tools such as Jenkins or Airflow.
• Excellent problem-solving skills and ability to troubleshoot complex issues in a timely manner.
• Strong communication and collaboration skills, with the ability to work in a fast-paced and agile environment.
• GCP certifications such as Google Certified Professional Data Engineer is a plus.

Apply now and take your career to the next level!.