If you are a self-motivated individual with a passion for data and a strong background in data processing, we want to hear from you.
Position: Data Processing Architect
Job Description: We are seeking a highly skilled and experienced Data Processing Architect to join our team. In this role, you will be responsible for designing, developing, and implementing data processing systems and solutions. You will work closely with our data engineering and data science teams to ensure the efficient processing of large volumes of data.
Key Responsibilities:
- Develop and maintain data processing architecture, including data ingestion, storage, transformation, and delivery.
- Design and implement data pipelines to ensure the smooth flow of data from various sources.
- Collaborate with data engineers to optimize data processing and storage systems for high performance and scalability.
- Work closely with data scientists to understand their data requirements and provide them with the necessary tools and infrastructure to perform their analyses.
- Develop and maintain data processing standards and best practices within the organization.
- Monitor and troubleshoot data processing systems to ensure data integrity and accuracy.
- Stay up-to-date with industry trends and advancements in data processing technologies, and propose and implement new solutions as needed.
- Mentor and train junior data processing team members.
Requirements:
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
- Minimum of 5 years of experience in data processing architecture and design.
- Strong knowledge of data processing principles, methodologies, and tools.
- Experience in designing and implementing data pipelines using tools such as Apache Spark, Hadoop, or Kafka.
- Experience with cloud-based data processing platforms such as AWS, Azure, or Google Cloud.
- Familiarity with programming languages such as Python, Java, or Scala.
- Excellent problem-solving skills and ability to troubleshoot complex data processing issues.
- Strong communication and collaboration skills to work effectively with cross-functional teams.
- Proven ability to handle multiple projects and priorities in a fast-paced environment.
- Knowledge of data governance and security practices is a plus.
Join our dynamic team and help us build robust and efficient data processing systems to drive insights and enable data-driven decision-making.