Big Data Engineer

Join our team and be a part of our exciting journey towards building a robust and scalable data infrastructure

Position: Big Data Engineer

Location: San Francisco, California, United States

Salary: $190000 - $224000

Overview: We are seeking a highly skilled and experienced Big Data Engineer to join our growing team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure and systems. You will play a crucial role in ensuring the quality, reliability, and scalability of our data pipelines and processes. This is an exciting opportunity to work with cutting-edge technologies and make a significant impact on our organization's data-driven approach.

Key Responsibilities:

• Design and develop data pipelines to ingest, process, and store large volumes of structured and unstructured data from various sources.
• Collaborate with data scientists and analysts to understand business requirements and translate them into technical solutions.
• Build and maintain data warehouses, data lakes, and other data storage solutions.
• Optimize data infrastructure for performance, scalability, and cost-efficiency.
• Ensure data quality and integrity by implementing data validation and monitoring processes.
• Identify and troubleshoot data-related issues and implement timely and effective solutions.
• Work with cross-functional teams to integrate data from different systems and applications.
• Keep up-to-date with the latest trends and developments in big data technologies and propose new solutions to improve our data infrastructure.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Minimum of 3 years of experience in a similar role, preferably in a fast-paced environment.
• Strong experience with big data technologies such as Hadoop, Spark, Kafka, and NoSQL databases.
• Proficiency in programming languages such as Java, Python, or Scala.
• Experience with data warehousing and ETL tools such as SQL, Talend, or Informatica.
• Familiarity with cloud computing platforms (AWS, Azure, or Google Cloud) and their data services.
• Excellent problem-solving skills and the ability to think critically and analytically.
• Strong communication skills and the ability to collaborate effectively with cross-functional teams.
• Experience with agile methodologies and version control tools (Git, SVN, etc.).
• Familiarity with data modeling, data governance, and data security best practices.
• Passion for learning new technologies and staying updated with industry trends.

We Offer:

• Competitive salary and benefits package.
• Professional development opportunities and training.
• A dynamic and collaborative work environment.
• The opportunity to work with cutting-edge technologies and make a significant impact on our organization's data capabilities.

Apply now and become a valuable member of our team!