DoableFromHome
← Back to your search

Jade Global

Databricks Lead – Delivery & Engineering

Engineering

Employment

Full-time
From the employer

Full time

Level

Lead

Category

Engineering
Not doable from Austria

Country assessment

Not doable from Austria because it is tied to an office and never says it can be done remotely.

Our assessment is guidance. Confirm arrangements with the employer.

Skills mentioned in this posting

CI/CDObservability

Job description

Databricks Lead – Delivery & Engineering1

Lead hands-on Databricks delivery, ensuring adherence to CoE standards and best practices.

Key Responsibilities

  • Lead Databricks engineering teams

  • Build and optimize Spark & Delta Lake pipelines

  • Implement Databricks Jobs, Workflows, CI/CD

  • Optimize performance and DBU usage

  • Contribute to Databricks accelerators and standards

  • Design and implement end-to-end data platforms using Databricks Lakehouse

  • Lead development of:

    • Data ingestion (batch & streaming)

    • Delta Lake data modeling (Bronze/Silver/Gold)

    • Scalable ETL/ELT pipelines

  • Optimize Spark workloads for performance and cost

  • Ensure reliability, scalability, and observability of data pipelines

Experience

  • 10–12 years in data engineering

  • 3–5 years hands-on Databricks experience

Skills

  • Deep expertise in Databricks, Apache Spark, Delta Lake

  • Strong hands-on experience with PySpark / Spark SQL  (core, SQL, streaming)

  • Experience designing Lakehouse architectures

  • Strong understanding of data modeling, data quality, and lineage

  • Databricks platform features

  • Cloud-native data engineering

  • Performance tuning & troubleshooting

Certifications (Preferred)

  • Databricks Data Engineer Associate and Professional