Job Description

Platform Engineer (AWS / Databricks)
London (Hybrid)
6 Month Contract
£600/day (Inside IR35)

Platform Engineer needed with strong AWS, Databricks and Unity Catalog experience. Start ASAP in May/June 2026.

6 Month Rolling Contract based in London (Hybrid), with occasional travel to the Leeds office.

Hybrid Working - 3-4 days/week remote (WFH) + 1-2 days/week working from the office in London.

A chance to work with a leading global IT transformation business specialising in large-scale Government projects:

• Supporting secure integration between AWS hosted data sources, Databricks workspaces and downstream enterprise data platforms.
• Design and support secure integration across AWS S3, Databricks and downstream data platforms.
• Strong hands-on experience with AWS IAM, S3, KMS and secure cloud access patterns.
• Hands-on Databricks on AWS experience, including Hive Metastore, Delta tables, SQL Warehouse and workspace access controls.
• Practical Unity Catalog experience, including grants, external locations, storage credentials and governed data access.
• Scope includes data held in S3, registered through Databricks Hive Metastore, governed or exposed through Unity Catalog, and consumed through approved connector-based patterns.
• Configure least-privilege access to S3 using IAM roles, bucket policies, KMS permissions and approved access controls.
• Support Databricks access patterns where S3-backed data is registered through Hive Metastore and exposed or migrated into Unity Catalog.
• Configure and validate Unity Catalog objects, including catalogs, schemas, tables, views, grants, storage credentials and external locations.
• Support downstream connectivity to Databricks using SQL Warehouse, tables, views or connector-based integration patterns.
• Develop Terraform/IaC for AWS IAM, S3, KMS and Databricks-related configuration.
• Troubleshoot access, metadata, schema, query and connectivity issues across AWS, Databricks and downstream integrations.
• Technical Environment: AWS, Databricks, Unity Catalog, Palantir Foundry, Terraform, IaC, Delta, Parquet, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions.