Apply now and take the first step towards an exciting career as a Big Data Engineer at Lobox!
Position: Big Data Engineer
Location: San Francisco, California, United States
Salary: $190000 - $224000
Employment Type: Full-time
About the Role: Lobox is seeking a highly skilled and innovative Big Data Engineer to join our dynamic team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure and tools. You will play a crucial role in building and optimizing our data pipeline architecture, as well as ensuring the smooth and efficient flow of data throughout our organization.
Key Responsibilities:
- Design, build and maintain our big data infrastructure, including data lakes, data warehouses, and data pipelines
- Collaborate with cross-functional teams to identify and understand business requirements, and translate them into technical specifications
- Develop and implement data ingestion processes from various structured and unstructured sources
- Design and develop scalable and optimized data processing solutions using Hadoop, Spark, and other big data technologies
- Monitor and troubleshoot data processing issues, and implement solutions in a timely manner
- Optimize data storage and retrieval for improved performance and cost efficiency
- Ensure data integrity and quality by implementing data validation and cleansing processes
- Collaborate with data scientists and analysts to build data models and implement machine learning algorithms
- Stay up-to-date with emerging big data technologies and tools, and make recommendations for their integration into our data infrastructure
- Document data architecture, processes, and workflows for future reference and knowledge sharing
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field
- Minimum of 3 years of experience in a similar role, preferably in a fast-paced environment
- Strong knowledge of big data technologies such as Hadoop, Spark, Kafka, and NoSQL databases
- Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud
- Proficient in programming languages such as Java, Python, or Scala
- Experience with data modeling, ETL processes, and data warehousing
- Familiarity with data visualization tools such as Tableau or Power BI
- Strong analytical and problem-solving skills
- Excellent communication and collaboration skills
- Ability to work independently and in a team environment
- Experience with Agile methodologies is a plus
Join our team and be a part of a fast-growing organization where you can apply your skills and expertise to make a significant impact. We offer a competitive salary, comprehensive benefits package, and a supportive work environment where your career growth is our top priority.