Big Data Engineer

If you are a self-motivated and results-driven individual with a passion for big data, we would love to hear from you

Position: Big Data Engineer

Location: San Francisco, California, United States

Salary: $190000 - $224000

Overview: We are seeking a highly skilled and experienced Big Data Engineer to join our dynamic team. As a Big Data Engineer, you will be responsible for designing, building, and maintaining our company's big data infrastructure. You will work closely with data scientists and analysts to develop and implement complex data solutions that drive business insights and improve overall data quality. We are looking for a proactive and innovative individual who is passionate about leveraging cutting-edge technologies to solve business challenges.

Key Responsibilities:

• Design, build, and maintain our company's big data infrastructure
• Develop and implement data ingestion processes from various structured and unstructured data sources
• Collaborate with data scientists and analysts to understand data requirements and translate them into technical solutions
• Design, develop, and maintain data pipelines to support data analytics and machine learning initiatives
• Ensure data quality and integrity by performing data validation and testing
• Monitor and troubleshoot data pipelines and resolve any issues in a timely manner
• Optimize and tune data processes to improve performance and efficiency
• Stay up-to-date with industry trends and advancements in big data technologies to continuously enhance our data infrastructure
• Document and maintain technical specifications and data architecture diagrams

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field
• Minimum of 3 years of experience working as a Big Data Engineer or a similar role
• Proven experience in designing, building, and maintaining big data infrastructure using Hadoop, Spark, or other related technologies
• Strong programming skills in Java, Python, or Scala
• Experience with data warehousing concepts and SQL
• Familiarity with cloud computing platforms such as AWS, Azure, or Google Cloud
• Working knowledge of ETL tools such as Informatica or Talend
• Experience with data visualization tools like Tableau or Power BI is a plus
• Excellent problem-solving and analytical skills
• Ability to work in a fast-paced and dynamic environment
• Strong communication and interpersonal skills

Join our team and be a part of our exciting journey towards leveraging data to drive business success.