If you are passionate about Big Data and have a strong desire to learn and grow, we encourage you to apply for this exciting opportunity
Job Title: Big Data Hadoop Engineer
Location: San Francisco, California, United States
Salary: $228000 - $288000
Position Overview: We are looking for a highly skilled Big Data Hadoop Engineer to join our dynamic and innovative team. As a Big Data Hadoop Engineer, you will be responsible for designing, developing, and maintaining our Big Data infrastructure and solutions. You will play a crucial role in managing and optimizing our data pipelines and ensuring the availability, scalability, and performance of our Big Data systems.
Key Responsibilities:
- Design, develop, and maintain our Big Data infrastructure, including Hadoop clusters, data lakes, and data warehouses.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Develop and implement data ingestion and processing pipelines using Hadoop ecosystem tools such as Spark, Hive, Kafka, and Sqoop.
- Monitor and troubleshoot performance issues and ensure the availability and reliability of our Big Data systems.
- Perform data modeling, data aggregation, and data cleansing to support data analytics and reporting needs.
- Optimize and tune Hadoop clusters and related infrastructure to improve system performance and efficiency.
- Stay updated with the latest Big Data technologies and trends and recommend innovative solutions to enhance our data capabilities.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Minimum of 3 years of experience working with Big Data technologies, particularly Hadoop.
- Strong understanding of Hadoop ecosystem components and their functionalities.
- Proficiency in programming languages such as Java, Python, or Scala.
- Experience with data modeling, ETL processes, and data warehousing concepts.
- Familiarity with cloud platforms such as AWS, GCP, or Azure.
- Excellent problem-solving skills and ability to troubleshoot complex issues.
- Strong communication and collaboration skills to work effectively with cross-functional teams.
- Proven track record of delivering high-quality and scalable Big Data solutions.
Why Work with Us: Joining our team as a Big Data Hadoop Engineer means being part of a fast-paced and dynamic environment where you can make a significant impact. You will have the opportunity to work with cutting-edge technologies and collaborate with highly skilled professionals to solve complex data challenges. We offer competitive compensation, benefits, and growth opportunities to ensure our employees are motivated and engaged in their work.
We are committed to creating an inclusive and diverse workplace and welcome applicants from all backgrounds and experiences. Join us and be part of our journey to transform our data capabilities and drive business success.