Databricks Engineer

Next Ventures is currently working with a giant consultancy firm to bring on 2 Databricks Engineers for projects involving:

• Data Ingestion
• Data Migration

This will be a freelance contact lasting a minimum of 12 months but will very likely be extended for another 12 months.

End client is in the finance sector

Requirements

• Minimum 6 Years of experience data engineering
• Minimum 3 Years of experience hands on with Databricks

Responsibilities

• Design and develop data pipelines using PySpark, Delta Lake, and Databricks Workflows.
• Implement ETL / ELT pipelines for structured and unstructured data.
• Optimize Databricks clusters, jobs, and notebooks for performance and cost efficiency.
• Build data quality and observability frameworks using Delta Live Tables, Unity Catalog, and MLflow.

If you're interested and want to find out more, lets have a chat.