Big Data Developer

As a Big Data Developer, you will have the opportunity to work with cutting-edge technologies and play a crucial role in driving our company's data-driven decision-making processes

Position: Big Data Developer

Location: New York, New York, United States

Salary: $190000 - $224000

We are seeking a highly skilled Big Data Developer to join our dynamic team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining our company's big data infrastructure. You will play a crucial role in our data management strategy, ensuring the availability, security, and scalability of our large and complex datasets.

Key Responsibilities:

• Design and implement big data solutions to store, process, and analyze large volumes of data
• Develop and maintain ETL pipelines for data ingestion and transformation from various sources
• Collaborate with data scientists and analysts to understand data requirements and develop data models
• Optimize and tune the performance of our big data systems to handle large and diverse datasets
• Ensure data quality and integrity by implementing data validation and cleansing processes
• Monitor and troubleshoot data processing and storage systems to identify and resolve issues
• Develop and maintain documentation of data pipelines, processes, and systems
• Stay updated with the latest trends and technologies in big data and contribute to the continuous improvement of our systems

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field
• Minimum of 3 years of experience in software development, preferably in big data technologies
• Strong proficiency in Java, Python, or other programming languages used in big data development
• Experience with big data processing frameworks such as Hadoop, Spark, or Kafka
• Familiarity with relational and NoSQL databases and data warehousing concepts
• Knowledge of ETL tools and techniques for data transformation and processing
• Experience with cloud computing platforms, such as AWS, Azure, or Google Cloud
• Excellent problem-solving and analytical skills
• Strong communication and collaboration skills
• Ability to work in a fast-paced, agile environment and handle multiple projects simultaneously

If you are passionate about big data and have a strong technical background, we would love to hear from you. Join our team and be a part of our journey towards harnessing the power of big data to drive business success.