Data Pipeline Architect

If you are a self-motivated and results-driven individual with a passion for data engineering and architecture, we would love to hear from you.

Job Title: Data Pipeline Architect

Position Overview: We are seeking a highly skilled and experienced Data Pipeline Architect to join our dynamic team. As a Data Pipeline Architect, you will play a critical role in designing and implementing our data pipeline infrastructure, ensuring the efficient and effective flow of data across our organization. You will work closely with cross-functional teams, including data analysts, engineers, and business stakeholders, to understand their data needs and develop robust and scalable solutions. The ideal candidate will have a strong background in data engineering and architecture, with a deep understanding of data pipelines and ETL processes.

Key Responsibilities:

• Design and develop end-to-end data pipelines, including data ingestion, processing, transformation, and storage
• Collaborate with data analysts and business stakeholders to understand data requirements and translate them into technical specifications
• Conduct data profiling and analysis to identify data quality issues and implement data cleansing and enrichment processes
• Optimize data pipelines for performance, scalability, and reliability, ensuring high availability and data consistency
• Develop and maintain documentation for data pipelines, including data lineage, data dictionaries, and data flow diagrams
• Stay up-to-date with the latest technologies and trends in data engineering and architecture, and propose new solutions to improve our data pipeline infrastructure
• Troubleshoot and resolve issues with data pipelines, working closely with the engineering team to implement timely and effective solutions
• Implement data security and access controls to ensure the confidentiality and integrity of our data
• Mentor and provide guidance to junior data engineers, fostering a culture of continuous learning and development within the team

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• Minimum of 5 years of experience in data engineering and architecture, with a focus on data pipelines and ETL processes
• Proficiency in SQL and experience working with relational databases, such as MySQL, PostgreSQL, or Oracle
• Strong programming skills in at least one language, such as Python, Java, or Scala
• Experience with big data technologies, such as Hadoop, Spark, or Kafka
• Knowledge of cloud platforms, such as AWS, Azure, or Google Cloud, and experience with cloud-based data services, such as Redshift, BigQuery, or Snowflake
• Familiarity with data modeling concepts and techniques, such as star schemas and data warehousing
• Excellent problem-solving and analytical skills, with the ability to understand complex data systems and identify opportunities for improvement
• Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and communicate technical concepts to non-technical stakeholders

Join our team and be part of a fast-paced and innovative environment, where you will have the opportunity to make a significant impact on our data capabilities.