If you are a self-motivated and results-driven individual with a passion for data engineering and reliability, we want to hear from you! Join our team and be a part of our journey to revolutionize the way data is used in our industry.
Job Title: Principal Data Reliability Engineer
Location: New York, New York, United States
Salary: $138 Per hour
Overview: We are seeking a highly experienced and skilled Principal Data Reliability Engineer to join our dynamic and innovative team. As a Principal Data Reliability Engineer, you will be responsible for the overall reliability, scalability, and availability of our data systems. You will play a crucial role in ensuring that our data infrastructure can handle the ever-increasing volume of data and support our business growth.
Responsibilities:
- Design, implement and maintain highly reliable and scalable data systems that support our business needs and ensure maximum uptime.
- Collaborate with cross-functional teams to identify and understand data requirements and translate them into technical solutions.
- Develop and maintain monitoring systems to proactively identify potential issues and troubleshoot them in a timely manner.
- Continuously analyze and optimize data systems for performance, scalability, and reliability.
- Work closely with the software engineering team to ensure that data pipelines and ETL processes are efficient and reliable.
- Lead the development and implementation of disaster recovery and backup strategies.
- Develop and maintain documentation for data systems and processes for internal and external stakeholders.
- Keep up-to-date with the latest technologies and trends in data engineering and recommend and implement improvements to our systems.
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred.
- 8+ years of experience in data engineering, data infrastructure, or a related field.
- Strong experience with cloud-based data platforms such as AWS, Azure, or Google Cloud.
- In-depth knowledge of data warehousing, ETL processes, and data modeling.
- Proficiency in programming languages such as Python, Java, or Scala.
- Experience with data pipeline tools like Apache Airflow, Luigi, or AWS Data Pipeline.
- Proven experience in building and maintaining highly available and scalable data systems.
- Strong problem-solving skills and ability to troubleshoot complex issues.
- Excellent communication and collaboration skills.
- Ability to work in a fast-paced and dynamic environment.