We offer a competitive salary, comprehensive benefits package and a dynamic work environment where you will have the opportunity to work with cutting-edge technologies and make a significant impact on our company's data strategy. If you are a Databricks expert with a passion for data and analytics, we would love to hear from you.
Job Title: Databricks Engineer
Position Overview: We are seeking a highly skilled and experienced Databricks Engineer to join our dynamic team. As a Databricks Engineer, you will be responsible for designing, developing, and maintaining our Databricks platform to support our company's data and analytics needs. This role requires a deep understanding of Databricks architecture and the ability to work with large datasets to deliver efficient and reliable solutions.
Key Responsibilities:
- Design, develop and maintain highly scalable and performant Databricks platform
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions
- Implement data ingestion processes and pipelines from various data sources into Databricks
- Optimize and tune Databricks clusters for efficient data processing and analytics
- Troubleshoot and resolve complex issues related to Databricks platform and data pipelines
- Develop and maintain documentation of Databricks platform architecture, processes and procedures
- Stay updated with the latest Databricks features and integrations and recommend their implementation to improve our platform
- Ensure data security and compliance standards are met throughout the Databricks platform
- Mentor and provide technical guidance to junior team members
Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering or a related field
- Minimum of 3 years of experience working as a Databricks Engineer or in a similar role
- Extensive experience with Databricks architecture and components such as clusters, jobs, notebooks, libraries, etc.
- Strong understanding of data warehousing concepts and experience with relational and NoSQL databases
- Hands-on experience with programming languages like Python, Scala, or Java
- Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud
- Knowledge of SQL and query optimization techniques
- Excellent problem-solving and troubleshooting skills
- Ability to work independently and in a team environment
- Strong communication and collaboration skills
- Relevant certifications in Databricks or cloud platforms are a plus
Join our team and be a part of our exciting journey towards data-driven success!.