Big Data Engineer

Join our team and be part of a fast-growing company that values innovation and encourages professional development

Job Title: Big Data Engineer

Location: New York, New York, United States

Salary: $107 Per hour

Job Overview: We are looking for a highly skilled and experienced Big Data Engineer to join our dynamic team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our company's data infrastructure and systems. You will work closely with our data scientists and business analysts to ensure the smooth flow of data and provide valuable insights to drive business decisions. The ideal candidate will have a strong background in data engineering, database management, and programming. If you are passionate about working with large and complex datasets and using cutting-edge technologies, then this is the perfect opportunity for you.

Key Responsibilities:

• Design, develop, and maintain our company's data infrastructure and systems, including data warehouses, data lakes, and ETL processes
• Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions
• Develop and implement data pipelines to ingest, process, and transform large volumes of data from various sources
• Optimize and tune data pipelines and databases for performance and scalability
• Monitor data quality and integrity, troubleshoot and resolve any issues that arise
• Work with data scientists and business analysts to provide timely and accurate data for analysis and reporting
• Identify and implement new technologies and tools to improve data processing and analysis
• Ensure data security and compliance with data privacy regulations
• Document data processes, procedures, and standards
• Provide technical guidance and mentorship to junior data engineers

Requirements:

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field
• Minimum of 3 years of experience as a Data Engineer or a similar role
• Strong experience with SQL and database management, including data modeling and performance tuning
• Proficient in one or more programming languages such as Python, Java, or Scala
• Hands-on experience with big data technologies such as Hadoop, Spark, Hive, or Kafka
• Familiarity with cloud-based data platforms such as AWS, Azure, or Google Cloud
• Experience with data visualization tools and techniques
• Excellent problem-solving skills and attention to detail
• Strong communication and collaboration skills
• Ability to work in a fast-paced and dynamic environment
• Passion for learning and keeping up-to-date with the latest trends and technologies in the field of data engineering

We offer a competitive salary, comprehensive benefits package, and a supportive work culture. If you have a passion for data and want to make a significant impact, apply now and be part of our exciting journey!