Big Data Engineer

Join our team and be a part of a company that values innovation, teamwork, and personal growth

Job Title: Big Data Engineer

Location: New York, New York, United States

Salary: $190000 - $224000

Position Overview: We are seeking an experienced Big Data Engineer to join our dynamic and growing team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our company's data architecture, as well as managing large-scale data infrastructure projects. With your strong technical skills and expertise in handling big data, you will play a crucial role in driving data-driven decision-making and optimizing business processes.

Key Responsibilities:

• Design, develop, and maintain our company's data architecture, including data warehouses, data lakes, and data pipelines.
• Collaborate with cross-functional teams to understand data requirements and design efficient and scalable data solutions.
• Implement data governance and security policies to ensure the integrity and confidentiality of our data.
• Develop and maintain ETL processes to extract, transform, and load data from various sources into our data warehouse.
• Design and implement data pipelines to transfer data from on-premises systems to cloud-based platforms.
• Monitor and troubleshoot data pipelines to ensure data quality and availability.
• Continuously evaluate and implement new technologies and tools to improve data processing and analysis.
• Work closely with data analysts and data scientists to provide them with clean, reliable, and well-organized data for their analysis.
• Collaborate with software engineers to integrate data solutions with our company's applications.
• Manage and mentor junior data engineers to ensure the successful delivery of data projects.

Qualifications:

• Bachelor's degree in Computer Science, Information Systems, or a related field. Master's degree is a plus.
• Proven work experience as a Big Data Engineer or similar role.
• Strong experience with big data technologies such as Hadoop, Spark, Hive, and Kafka.
• Proficient in SQL and experience with relational databases (e.g. MySQL, PostgreSQL).
• Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud.
• Familiarity with data warehouse design and data modeling.
• Experience with ETL tools such as Informatica, Talend, or DataStage.
• Strong programming skills in languages such as Python, Java, or Scala.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Ability to work in a fast-paced and dynamic environment.
• Experience with Agile methodologies is a plus.

As a Big Data Engineer, you will have the opportunity to work with cutting-edge technologies and make a significant impact on our company's success. Apply now and become a part of our exciting journey towards data-driven excellence.