Data Pipeline Developer

If you are a self-motivated, results-driven individual with a passion for data engineering and a desire to work with big data, we would love to hear from you! Apply now and join our team as a Data Pipeline Developer.

Job Title: Data Pipeline Developer

Job Overview: We are seeking a highly skilled and experienced Data Pipeline Developer to join our dynamic team. As a Data Pipeline Developer, you will be responsible for designing, developing, and maintaining data pipelines that facilitate the extraction, transformation, and loading (ETL) of large and complex data sets. You will work closely with our data engineering and data science teams to ensure the timely and accurate delivery of data to support various business needs. The ideal candidate will have a strong background in data engineering and programming, as well as a passion for working with big data.

Key Responsibilities:

• Design and develop data pipelines to support the ETL process for large and complex data sets
• Work closely with data engineers and data scientists to understand data requirements and develop efficient and scalable solutions
• Utilize programming languages such as Python, Java, or Scala to build and maintain data pipelines
• Monitor and troubleshoot data pipelines to ensure data accuracy and reliability
• Identify and implement improvements to optimize data pipeline performance
• Collaborate with cross-functional teams to develop solutions for data-related issues and challenges
• Document data pipeline processes and maintain data pipeline documentation
• Stay up-to-date with industry trends and best practices in data engineering and data management

Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field
• Minimum of 3 years of experience in data engineering, ETL development, or a similar role
• Strong programming skills in languages such as Python, Java, or Scala
• Experience with big data technologies such as Hadoop, Spark, or Kafka
• Proficient in SQL and database management
• Familiarity with data warehousing concepts and methodologies
• Experience with cloud computing platforms such as AWS, Azure, or Google Cloud
• Excellent problem-solving and analytical skills
• Ability to work independently and in a team environment
• Strong communication and interpersonal skills

Why Join Our Team?

• Opportunity to work with cutting-edge technologies and large and complex data sets
• Collaborative and fast-paced work environment
• Competitive salary and benefits package
• Professional development and growth opportunities
• Chance to make a significant impact on the company's data-driven decisions