Big Data Developer

We are looking for a highly motivated and results-driven individual who is passionate about working with big data and has a strong desire to continuously learn and improve

Position: Big Data Developer

Location: New York, New York, United States

Salary: $107 Per hour

Job Description: As a Big Data Developer, you will be responsible for designing, developing, and implementing complex big data solutions for our organization. You will work closely with a team of data scientists, engineers, and business analysts to ensure the successful delivery of data-driven solutions. Your primary focus will be on building scalable and efficient data pipelines to process large datasets and generate insights.

Key Responsibilities:

• Design and develop data ingestion processes to extract and load data from various structured and unstructured sources into our data lake
• Build and maintain data pipelines to transform, cleanse, and manipulate data using tools such as Spark, Hadoop, and Kafka
• Develop data models and algorithms to support data analytics and reporting needs
• Collaborate with data scientists to integrate machine learning models into production systems
• Work closely with business analysts to understand data requirements and translate them into technical specifications
• Conduct performance tuning and optimization of big data solutions to ensure efficient processing of large datasets
• Troubleshoot and resolve issues related to data quality, consistency, and integrity
• Stay up-to-date with the latest big data technologies and tools and recommend their implementation in our systems

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field
• Minimum of 3 years of experience in big data development, preferably in a fast-paced and agile environment
• Proficient in programming languages such as Java, Python, and Scala
• Strong experience with big data technologies such as Hadoop, Spark, Kafka, and NoSQL databases
• Familiarity with data warehousing concepts and tools such as Redshift, Snowflake, or BigQuery
• Experience with data modeling, data integration, and ETL processes
• Good understanding of data governance and security principles
• Excellent problem-solving and analytical skills
• Ability to work in a team and communicate effectively with technical and non-technical stakeholders

If you have a strong technical background, a knack for solving complex problems, and a passion for big data technologies, then this is the perfect opportunity for you to take your career to the next level. Join our dynamic team and be a part of revolutionizing how we use data to drive business decisions.