Big Data Engineer

Join our team and be part of a dynamic and innovative company that is utilizing big data to drive business growth and success

Position: Big Data Engineer

Location: San Francisco, California, United States

Company: Lobox

Job Type: Full-time

Industry: Information Technology & Services

Salary: $190000 - $224000

Are you passionate about working with large datasets and transforming raw data into valuable insights? Do you have a strong background in software engineering and a deep understanding of big data technologies? If so, we have an exciting opportunity for you to join our team as a Big Data Engineer.

As a Big Data Engineer, you will be responsible for designing, building, and maintaining our big data infrastructure. You will work closely with our data scientists and analysts to ensure that our data is stored, processed, and accessible in a secure and efficient manner. You will also collaborate with cross-functional teams to identify and implement solutions that will improve our data processing capabilities and enable us to extract meaningful insights from our data.

Key Responsibilities:

• Design, develop, and maintain our big data infrastructure, including data pipelines, data warehouses, and data lakes.
• Collaborate with data scientists and analysts to understand data requirements and translate them into scalable data solutions.
• Identify and implement new technologies and tools to enhance our data processing capabilities and improve data quality.
• Troubleshoot and optimize performance issues in the data processing pipeline.
• Work with cross-functional teams to ensure data security and compliance with data governance policies.
• Develop and maintain documentation for data infrastructure and processes.
• Stay updated with industry trends and technologies in the big data space and make recommendations for improvements.

Requirements:

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
• Minimum of 3 years of experience in big data engineering or a similar role.
• Strong programming skills in languages such as Java, Python, or Scala.
• Experience with big data technologies, such as Hadoop, Spark, Kafka, and NoSQL databases.
• Familiarity with cloud computing platforms, such as AWS, Azure, or Google Cloud.
• Knowledge of data warehousing concepts and tools, such as Redshift, Snowflake, or BigQuery.
• Experience with data modeling, data integration, and data visualization.
• Strong problem-solving and analytical skills.
• Excellent communication and teamwork abilities.
• Ability to work in a fast-paced and dynamic environment.
• Certification in big data technologies is a plus.

We offer a competitive salary, comprehensive benefits package, and opportunities for career advancement. Apply now and take the first step towards an exciting and rewarding career as a Big Data Engineer!