Big Data Engineer

We are looking for a passionate and driven Big Data Engineer who is eager to take on new challenges and contribute to our company's success

Job Title: Big Data Engineer

Location: San Francisco, California, United States

Salary: $190000 - $224000

Position Overview: We are seeking a highly skilled and motivated Big Data Engineer to join our dynamic team. As a Big Data Engineer, you will be responsible for designing, building, and maintaining our company's big data infrastructure. You will work closely with our data scientists and analysts to ensure that our data is accurate, accessible, and secure. The ideal candidate will have a strong background in data engineering, as well as a passion for working with large, complex data sets.

Key Responsibilities:

• Design and implement scalable and reliable big data solutions that meet the needs of our organization
• Collaborate with cross-functional teams to identify and prioritize business requirements and translate them into technical specifications
• Develop and maintain data pipelines to ingest, process, and store large volumes of data from various sources
• Optimize and tune data warehouse and ETL processes to ensure high performance and data quality
• Troubleshoot and resolve any issues related to data processing and storage
• Monitor and ensure the security and integrity of our data infrastructure
• Continuously evaluate and implement new tools and technologies to improve the efficiency and effectiveness of our big data solutions
• Document and communicate data architecture and processes to technical and non-technical stakeholders
• Mentor and provide technical guidance to junior data engineers

Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field
• Minimum of 3 years of experience as a data engineer or similar role
• Strong programming skills in languages such as Python, Java, or Scala
• Experience with big data technologies such as Hadoop, Spark, Hive, and Kafka
• In-depth knowledge of database design and SQL
• Familiarity with cloud platforms (AWS, Azure, or Google Cloud)
• Proven track record of designing and implementing large-scale data solutions
• Excellent problem-solving and analytical skills
• Strong communication and collaboration skills
• Ability to work in a fast-paced and agile environment
• Knowledge of data governance and data security best practices

Why Join Us:

• Opportunity to work with cutting-edge technologies and solve challenging problems
• Collaborative and inclusive work culture that values diversity and promotes personal growth
• Competitive salary and benefits package
• Flexible work hours and work-from-home options
• Opportunities for career advancement and ongoing learning and development
• Fun and engaging company events and team-building activities

If you have a strong background in data engineering and a desire to work with big data, we would love to hear from you. Join our team and be a part of shaping the future of our organization.