If you are a highly motivated and results-driven individual with a passion for data and technology, we would love to hear from you
Job Title: Data Engineer Consultant
Location: San Francisco, California, United States
Salary: $171000 - $208000
Job Description: We are seeking a highly skilled and experienced Data Engineer Consultant to join our team. As a Data Engineer Consultant, you will be responsible for designing, developing, and maintaining our data infrastructure and systems. You will work closely with our data scientists, analysts, and other stakeholders to ensure the accuracy, reliability, and efficiency of our data processes.
Key Responsibilities:
- Design, develop and maintain data architecture and infrastructure for our organization
- Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and requirements
- Develop and implement data pipelines to extract, transform, and load data from various sources into our data warehouse
- Optimize and fine-tune data processes to improve performance and scalability
- Conduct data quality checks and troubleshoot any data-related issues
- Design and implement data security measures to protect our data assets
- Stay updated with the latest data engineering tools and technologies and make recommendations for their implementation
- Train and mentor junior data engineers and provide technical guidance to other team members
- Work closely with cross-functional teams to ensure data integrity and consistency across different systems and applications
- Develop and maintain documentation for data processes, systems, and infrastructure
- Participate in data governance and compliance initiatives to ensure data privacy and regulatory compliance
- Identify opportunities for process improvement and drive automation and standardization of data processes
Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field
- Minimum of 5 years of experience in data engineering, preferably in a consulting role
- Strong experience with data warehouse design, data modeling, and ETL processes
- Proficiency in SQL and experience with relational databases such as MySQL, PostgreSQL, or SQL Server
- Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud
- Strong programming skills in at least one language such as Python, Java, or Scala
- Experience with big data technologies such as Hadoop, Spark, or Kafka
- Knowledge of data visualization tools such as Tableau, Power BI, or QlikView
- Excellent problem-solving and analytical skills
- Strong communication and collaboration skills
- Ability to work in a fast-paced and dynamic environment
- Relevant certifications in data engineering or cloud technologies are a plus
Come join our team and be a part of our mission to harness the power of data to drive business success.