Job Description

Platform Engineer (AWS / Databricks)

London (Hybrid)

6 Month Contract

£600/day (Inside IR35)

Platform Engineer needed with strong AWS, Databricks and Unity Catalog experience. Start ASAP in May/June 2026.

6 Month Rolling Contract based in London (Hybrid), with occasional travel to the Leeds office.

Hybrid Working - 3-4 days/week remote (WFH) + 1-2 days/week working from the office in London.

A chance to work with a leading global IT transformation business specialising in large-scale Government projects:

Supporting secure integration between AWS hosted data sources, Databricks workspaces and downstream enterprise data platforms.

Design and support secure integration across AWS S3, Databricks and downstream data platforms.

Strong hands-on experience with AWS IAM, S3, KMS and secure cloud access patterns.

Hands-on Databricks on AWS experience, including Hive Metastore, Delta tables, SQL Warehouse and workspace access controls.

Practical Unity Catalog experience, including grants, external locations, storage credentials and governed data access.

Scope includes data held in S3, registered through Databricks Hive Metastore, governed or exposed through Unity Catalog, and consumed through approved connector-based patterns.

Configure least-privilege access to S3 using IAM roles, bucket policies, KMS permissions and approved access controls.

Support Databricks access patterns where S3-backed data is registered through Hive Metastore and exposed or migrated into Unity Catalog.

Configure and validate Unity Catalog objects, including catalogs, schemas, tables, views, grants, storage credentials and external locations.

Support downstream connectivity to Databricks using SQL Warehouse, tables, views or connector-based integration patterns.

Develop Terraform/IaC for AWS IAM, S3, KMS and Databricks-related configuration.

Troubleshoot access, metadata, schema, query and connectivity issues across AWS, Databricks and downstream integrations.

Technical Environment: AWS, Databricks, Unity Catalog, Palantir Foundry, Terraform, IaC, Delta, Parquet, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions