Big Data Engineer

Join our team and be a part of a fast-growing company that is revolutionizing the way data is used to drive business decisions

Job Title: Big Data Engineer

Location: San Francisco, California, United States

Salary: $190000 - $224000

Position Overview: We are seeking a highly skilled and experienced Big Data Engineer to join our dynamic team. As a Big Data Engineer, you will be responsible for designing, building, and maintaining our company's big data infrastructure. You will work closely with our data scientists and analysts to ensure that our data is reliable, accessible, and secure. The ideal candidate will have a strong background in data engineering and a passion for working with large and complex datasets.

Key Responsibilities:

• Design and implement scalable and high-performance data pipelines for both batch and real-time data processing.
• Optimize and maintain our company's big data architecture, ensuring its availability, reliability, and scalability.
• Work closely with data scientists and analysts to understand their data needs and provide them with the necessary tools and infrastructure to access and analyze data.
• Collaborate with cross-functional teams to identify and implement new data sources and data-driven solutions.
• Troubleshoot and debug data-related issues in a timely manner.
• Develop and maintain data governance policies and procedures to ensure data integrity and security.
• Stay up-to-date with the latest trends and technologies in the big data space and make recommendations for their implementation.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
• Minimum of 3 years of experience as a Big Data Engineer.
• Strong experience with Hadoop, Spark, and other big data technologies.
• Proficiency in programming languages such as Java, Python, or Scala.
• In-depth understanding of data modeling, data warehousing, and data integration techniques.
• Experience with cloud-based data platforms, such as AWS or Azure.
• Knowledge of SQL and NoSQL databases.
• Excellent problem-solving and analytical skills.
• Strong communication and teamwork abilities.
• Ability to work in a fast-paced, deadline-driven environment.
• Experience with data visualization tools, such as Tableau or Power BI, is a plus.

We offer a competitive salary, benefits package, and opportunities for career growth and development. If you are a passionate and driven Big Data Engineer, we would love to hear from you! Apply now and be a part of our exciting journey towards success.