If you are a passionate and driven Big Data Principal Software Engineer looking to be part of a dynamic and innovative team, we encourage you to apply for this exciting opportunity
Position: Big Data Principal Software Engineer
Location: New York, New York, United States
Salary: $138 Per hour
We are seeking a highly skilled and experienced Big Data Principal Software Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and implementing big data solutions that will support our company's growing data needs. As a leader in our data engineering team, you will also play a critical role in defining the technical roadmap for our big data infrastructure.
Key Responsibilities:
- Design and develop scalable and robust big data solutions to support our data-driven initiatives
- Collaborate with cross-functional teams to gather and analyze business requirements and translate them into technical solutions
- Lead the development and implementation of data processing pipelines using cutting-edge technologies, such as Hadoop, Spark, and Kafka
- Ensure data quality and reliability by implementing data governance processes and conducting regular data audits
- Troubleshoot and resolve complex issues related to data processing, storage, and integration
- Stay up-to-date with industry trends and best practices in big data technologies and make recommendations on their adoption to enhance our data infrastructure
- Mentor and coach junior members of the data engineering team and provide technical guidance to help them grow and develop their skills
- Collaborate with data scientists and analysts to understand their data needs and provide support in data acquisition, transformation, and analysis
- Communicate technical concepts and solutions to non-technical stakeholders in a clear and concise manner
- Participate in code reviews, architecture discussions, and provide feedback to continuously improve the quality of our codebase
Requirements:
- Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field
- Minimum of 7 years of experience in software development, with a focus on big data technologies
- Strong command of programming languages such as Java, Python, and Scala
- In-depth knowledge of big data frameworks and tools, including Hadoop, Spark, and Kafka
- Experience with cloud computing platforms, such as AWS, Azure, or Google Cloud
- Proven track record of designing and implementing large-scale, high-performance, and fault-tolerant data processing systems
- Solid understanding of data modeling and database concepts
- Experience with agile methodologies and working in a fast-paced, collaborative environment
- Excellent problem-solving skills and the ability to think critically and analytically
- Strong communication and interpersonal skills to effectively collaborate with cross-functional teams
- Proven leadership skills and experience in mentoring and coaching junior team members
Join us and help shape the future of our big data infrastructure!