Key Responsibilities:

Design and develop the company's big data platform, including data ingestion, storage, processing, and retrieval
Collaborate with data engineers and data scientists to understand business requirements and translate them into technical solutions
Design and implement data models and schemas to support efficient data processing and analysis
Ensure the scalability, reliability, and security of the big data platform
Develop and maintain data pipelines to ingest data from various sources and transform it for analysis
Troubleshoot and resolve issues with data processing and storage
Monitor and optimize the performance of the big data platform
Stay up-to-date with the latest big data technologies and trends and make recommendations for adoption
Collaborate with cross-functional teams to integrate the big data platform with other systems and applications
Document the design, architecture, and processes of the big data platform for future reference
Train and mentor junior members of the team on big data platform design and development best practices

Requirements:

Bachelor's or Master's degree in Computer Science, Information Technology, or a related field
Minimum of 5 years of experience designing and developing big data platforms
In-depth knowledge of big data technologies such as Hadoop, Spark, Kafka, and NoSQL databases
Proficient in programming languages such as Java, Python, or Scala
Proven experience designing and implementing data models and schemas
Strong understanding of data warehousing and data mining concepts
Experience with cloud platforms such as AWS, Azure, or Google Cloud
Familiarity with data visualization tools like Tableau or Power BI
Excellent problem-solving and analytical skills
Strong communication and collaboration skills
Ability to work in a fast-paced and dynamic environment
Experience in Agile/Scrum methodologies is a plus

We offer a competitive salary, comprehensive benefits package, and opportunities for career growth and development. Apply now and take the next step towards becoming our Big Data Platform Designer.

Hashtags