Databricks Developer

If you are passionate about data and have a strong background in Databricks, we would love to hear from you

Position: Databricks Developer

Location: New York, New York, United States

Salary: $107 Per hour

Company Overview: Lobox is a leading provider of innovative data solutions for businesses across various industries. Our cutting-edge technology and expert team help organizations unlock the true potential of their data, enabling them to make data-driven decisions and achieve their business goals.

Job Overview: We are seeking a highly skilled Databricks Developer to join our team and play a crucial role in developing and maintaining our data platform. As a Databricks Developer, you will be responsible for designing, implementing, and optimizing data pipelines, data lakes, and data warehouses using Databricks. You will work closely with cross-functional teams to understand business requirements and translate them into efficient and scalable data solutions.

Key Responsibilities:

• Design and implement end-to-end data pipelines using Databricks, including data ingestion, transformation, and storage.
• Develop and maintain data lakes and data warehouses on Databricks, ensuring they are performant, scalable, and reliable.
• Collaborate with data engineers, data scientists, and business analysts to understand their data needs and provide them with the necessary data infrastructure.
• Monitor and troubleshoot Databricks jobs and clusters to ensure optimal performance and availability.
• Continuously optimize Databricks workflows, processes, and code to improve efficiency and reduce costs.
• Keep up-to-date with the latest Databricks features and industry best practices and incorporate them into our data platform.
• Document data pipelines, data schemas, and data governance policies for future reference.
• Participate in code reviews, testing, and deployment processes to ensure high-quality and error-free code.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
• Minimum of 3 years of experience in data engineering and development, with at least 2 years of hands-on experience with Databricks.
• Strong understanding of data warehousing concepts and data modeling techniques.
• Proficient in SQL, Python, and Scala. Experience with Java is a plus.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Strong understanding of data integration, ETL/ELT processes, and data governance.
• Experience with big data technologies such as Hadoop, Spark, and Kafka.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.

Why Join Lobox?

• Opportunity to work with cutting-edge technology and solve complex data challenges.
• Competitive salary and benefits package.
• Work with a dynamic and diverse team of experts in the field.
• Continuous learning and growth opportunities.
• A culture that values innovation, collaboration, and diversity.

Join our team and be a part of revolutionizing the way businesses use data to drive success. Apply now!