If you are a highly driven and skilled Databricks Engineer looking for a new challenge, we would love to hear from you! Join our team and be a part of our exciting journey towards data excellence.
Position: Databricks Engineer
Overview: We are seeking a highly skilled and experienced Databricks Engineer to join our dynamic team. As a Databricks Engineer, you will be responsible for designing, building, and maintaining our data platform on the Databricks platform. You will work closely with data scientists, data analysts, and other cross-functional teams to ensure the smooth operation of our data infrastructure and drive data-driven decision-making for our company.
Key Responsibilities:
- Design, build, and maintain our data platform on the Databricks platform
- Develop efficient and scalable data pipelines to process and transform large and complex datasets
- Monitor and troubleshoot the performance of our data platform, ensuring its reliability and availability
- Collaborate with data scientists and data analysts to understand their data requirements and provide technical solutions
- Work closely with cross-functional teams to identify and implement new data sources and tools to enhance our data capabilities
- Implement and maintain data security and access controls to ensure the protection of sensitive data
- Continuously evaluate and improve our data processes and infrastructure to optimize efficiency and performance
- Stay updated on the latest trends and advancements in data engineering and bring in new ideas and best practices to the team
Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field
- Minimum of 3 years of experience as a Data Engineer, with at least 1 year of hands-on experience with Databricks
- Strong knowledge of SQL, Python, and other programming languages
- Experience with data warehousing, data modeling, and ETL processes
- Familiarity with cloud platforms such as AWS, Azure, or Google Cloud
- Proven experience in building and maintaining data pipelines using tools like Spark, Kafka, or Airflow
- Ability to write efficient and optimized SQL queries and troubleshoot performance issues
- Excellent problem-solving and analytical skills
- Strong communication and collaboration skills to work effectively with cross-functional teams
- Self-motivated and able to work independently as well as in a team environment
We Offer:
- Competitive salary and benefits package
- A challenging and dynamic work environment where you can grow and learn
- Opportunity to work with cutting-edge technologies and drive data innovation for our company
- Supportive and collaborative team culture
- Flexible work hours and remote work options