Data Pipeline Architect

If you are a highly motivated and experienced Data Pipeline Architect looking to join a forward-thinking organization, we would love to hear from you

Position: Data Pipeline Architect

Location: New York, New York, United States

Salary: $138 Per hour

About the Role: We are seeking a highly skilled Data Pipeline Architect to join our dynamic and innovative team. In this role, you will be responsible for designing and implementing efficient and scalable data pipelines to support our organization's data processing and analytics needs. As a Data Pipeline Architect, you will work closely with our data engineering and business intelligence teams to develop solutions that will enable us to extract valuable insights from our vast amounts of data.

Key Responsibilities:

• Design and implement end-to-end data pipelines to support data processing, transformation, and storage
• Collaborate with cross-functional teams, including data engineers and business intelligence analysts, to understand data requirements and translate them into technical solutions
• Evaluate and select appropriate tools and technologies to optimize data pipeline performance and scalability
• Develop and maintain data pipeline documentation, including data flow diagrams and system architecture diagrams
• Monitor and troubleshoot data pipeline performance and resolve any issues that arise in a timely manner
• Ensure data pipeline security and compliance with data privacy regulations
• Continuously improve data pipeline processes and procedures to increase efficiency and effectiveness
• Stay up-to-date with industry trends and advancements in data pipeline technologies and make recommendations for their implementation in our organization

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field
• Minimum of 5 years of experience in data engineering or a similar role
• Proven track record of designing and implementing complex data pipelines in a production environment
• Strong understanding of data processing and ETL concepts
• Proficiency in one or more programming languages, such as Python, Java, or Scala
• Experience with big data technologies, such as Hadoop, Spark, or Kafka
• Knowledge of cloud computing platforms, such as AWS, Azure, or Google Cloud
• Familiarity with data warehouse and data lake architectures
• Excellent problem-solving and analytical skills
• Strong communication and collaboration abilities
• Ability to work in a fast-paced and dynamic environment

Apply now and be a part of a team that is revolutionizing the way we use data to drive business success.