Data Pipeline Architect

If you are a highly motivated and results-driven individual with a passion for data and technology, then we want to hear from you! Join our team and be a part of our exciting journey as we continue to revolutionize the way data is managed and utilized within our organization.

Job Title: Data Pipeline Architect

Location: San Francisco, California, United States

Salary: $247000 - $320000

Overview: We are seeking a highly skilled and experienced Data Pipeline Architect to join our dynamic and innovative team. As a Data Pipeline Architect, you will be responsible for designing, implementing, and maintaining data pipelines that enable the efficient and effective flow of data within our organization. You will play a crucial role in ensuring the accuracy, reliability, and security of our data, as well as optimizing its accessibility for our various data-driven initiatives.

Key Responsibilities:

• Design and develop efficient and scalable data pipelines that meet the business needs and objectives of our organization.
• Collaborate with cross-functional teams to identify data requirements and design appropriate solutions.
• Implement data governance policies and procedures to ensure data integrity, security, and compliance.
• Optimize data pipelines for performance and scalability, utilizing the latest technologies and techniques.
• Troubleshoot and resolve any issues with data pipelines, ensuring minimal downtime and maximum efficiency.
• Conduct regular data audits and implement data quality measures to ensure accuracy and reliability.
• Identify and recommend improvements to existing data pipelines, keeping abreast of industry best practices and emerging technologies.
• Work closely with data engineers and data scientists to ensure the seamless integration of data pipelines with data analytics and machine learning processes.
• Mentor and coach junior members of the team to enhance their technical skills and knowledge.
• Collaborate with other departments to understand their data needs and develop solutions to meet those needs.
• Stay updated on the latest trends and advancements in data pipeline technologies and make recommendations for their implementation.

Requirements:

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
• Minimum of 5 years of experience in data engineering, data architecture, or a similar role.
• Extensive experience in designing and implementing data pipelines using ETL tools such as Informatica, Talend, or Apache Airflow.
• Proficient in SQL and other database technologies such as MySQL, Oracle, or SQL Server.
• Strong understanding of data warehousing concepts and experience with data warehousing tools such as Redshift, Snowflake, or BigQuery.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Knowledge of programming languages such as Python, Java, or Scala.
• Experience with data governance and data security.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills.
• Ability to work in a fast-paced and constantly evolving environment.