Key Responsibilities:

Design and develop Databricks solutions to meet business requirements and ensure scalability, performance and reliability.
Collaborate with cross-functional teams to gather and understand data requirements and translate them into technical specifications.
Build and maintain data pipelines using Databricks, Spark and other big data technologies to ingest and process large volumes of data.
Develop and optimize ETL processes to ensure efficient data transformation and loading into Databricks.
Troubleshoot and resolve issues related to Databricks platform, data pipelines and ETL processes.
Implement best practices and design patterns for data management, processing and storage.
Work closely with data scientists to implement machine learning models and algorithms on Databricks platform.
Monitor and maintain the health of Databricks cluster and take necessary actions to optimize performance.
Keep up-to-date with the latest advancements in Databricks and big data technologies and recommend improvements to existing processes.

Qualifications:

Bachelor's or Master's degree in Computer Science, Information Systems or a related field.
Minimum of 3 years of experience in developing and maintaining Databricks platform.
Strong understanding of Databricks architecture and experience in building and optimizing data pipelines using Databricks, Spark and other big data technologies.
Proficiency in programming languages such as Python, R or Scala.
Experience in ETL development and data modeling.
Familiarity with cloud platforms such as AWS, Azure or Google Cloud.
Knowledge of machine learning techniques and experience in implementing machine learning models on Databricks.
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills.

Apply now to become our next Databricks Developer!

Hashtags