If you are a self-motivated and results-driven individual with a passion for big data, we would love to hear from you! Join our team and be a part of our exciting journey in harnessing the power of big data to drive business growth and innovation.
Position: Big Data Engineer
Job Description: We are seeking a highly skilled Big Data Engineer to join our dynamic team. As a Big Data Engineer, you will work closely with cross-functional teams to design, develop, and maintain our big data infrastructure. You will be responsible for building and optimizing data pipelines, as well as integrating and managing data from various sources. The ideal candidate will have a strong background in data engineering, with a passion for working with large datasets and a desire to continuously improve and optimize our data processes.
Responsibilities:
- Design, develop, and maintain big data infrastructure using the latest technologies and tools
- Build and optimize data pipelines to ensure efficient and reliable data processing
- Integrate and manage data from various sources, both structured and unstructured
- Work closely with data scientists and analysts to understand data requirements and ensure data quality and accuracy
- Develop and implement data governance policies and procedures
- Troubleshoot and resolve any issues related to data processing and storage
- Continuously monitor and optimize the performance of our big data systems
- Collaborate with cross-functional teams to identify and implement new data sources and tools
- Stay up-to-date with emerging technologies and trends in the big data space
Requirements:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- 3+ years of experience in data engineering, with a focus on big data systems
- Strong programming skills in languages such as Java, Python, or Scala
- Experience with big data technologies such as Hadoop, Spark, Kafka, and NoSQL databases
- Proficiency in SQL and database design
- Familiarity with cloud computing platforms such as AWS, Azure, or Google Cloud
- Strong analytical and problem-solving skills
- Excellent communication and teamwork abilities
- Ability to work in a fast-paced and dynamic environment
- Experience with data visualization tools is a plus