Job Description
Our client is a large international organization operating in infrastructure, construction, and property development, delivering major projects across transport, utilities, and public services.
They are scaling their enterprise data platform (Databricks) and investing in strong platform engineering foundations.
This is a hands-on platform engineering role focused on Infrastructure as Code, CI/CD, platform reliability, governance, and operational excellence across a modern Azure Databricks environment.
This is not a Data Engineering, Analytics, or BI role. Instead, you'll be responsible for the platform capabilities that enable data teams to deliver safely, consistently, and at scale.
What you will be doing:
As a Senior DataOps Engineer, you'll be responsible for designing, building, and operating the platform capabilities that enable data engineering teams to deploy and scale data workloads safely and consistently.
Infrastructure as Code & Platform Automation
- Design, implement, and maintain Infrastructure as Code using Terraform
- Build reusable modules and deployment patterns across multiple environments
- Automate provisioning and configuration of Azure and Databricks resources
- Implement policy-as-code and platform guardrails
- Drive platform standardisation and automation initiatives
CI/CD & Release Engineering
- Design and own CI/CD frameworks for Databricks assets
- Automate testing, validation, and deployment processes
- Implement environment promotion strategies across development, testing, and production
- Reduce manual deployment activities and operational risk
- Integrate source control and modern software engineering practices
Platform Reliability & Observability
- Develop monitoring, alerting, and operational dashboards
- Improve platform resilience, stability, and recoverability
- Design solutions for failure handling, rollback, and operational recovery
- Support platform performance optimisation and cost management
Governance & Security
- Implement access controls, security policies, and governance standards
- Automate compliance and security enforcement through code
- Collaborate with governance and architecture stakeholders to ensure alignment with enterprise standards
What we are looking for:
- Strong hands-on experience operating Databricks in enterprise environments
- Deep knowledge of Databricks workspaces, jobs, clusters, repositories, and Unity Catalog
- Expert-level Terraform experience, including module design and infrastructure automation
- Proven experience building CI/CD frameworks for complex cloud platforms
- Strong Python skills for automation and tooling
- Experience implementing monitoring, observability, and operational support capabilities
- Solid understanding of cloud security, access control, and governance principles
- Strong software engineering fundamentals and automation mindset
Nice-to-have:
- Enterprise-scale data platform experience
- Delta Lake, Delta Live Tables (DLT), and Databricks SQL
- Azure monitoring and observability tooling
- Event-driven or streaming architectures
- Experience working across platform, governance, and engineering teams
Contract type: Freelancer agreement, with an initial contract duration of 130 days (around 6 months)
Workplace type: The role is primarily remote, with the requirement of occasional travel to London.
Sounds exciting and want to know more?
- Apply directly or contact Keana Perez (Technical Recruiter)!
- Email: [email protected]