Job Description

Data Engineer

London / remote

429 per day inside IR35

6 months duration

Active SC clearance

We are seeking a Senior Data Engineer to join a high-performing team delivering large-scale cloud and data transformation programmes. This is an exciting opportunity to work on complex data platforms, leveraging modern cloud technologies and best-in-class engineering practices to build scalable, secure, and high-quality data solutions.

You'll play a key role in designing and developing data pipelines, integrating data from multiple sources, and helping organisations unlock the value of their data through robust engineering and architecture.

• Designing, developing, and optimising enterprise-scale data pipelines.
• Building cloud-native data solutions using AWS and Azure.
• Developing and supporting ETL/ELT processes using Informatica.
• Working with large datasets to ensure data quality, performance, and reliability.
• Collaborating with architects, developers, analysts, and business stakeholders.
• Supporting CI/CD, automation, and DevOps best practices.
• Contributing to Agile delivery teams and driving engineering excellence.

• Strong experience with Informatica.
• Proven delivery experience on data engineering or data transformation projects.
• Hands-on AWS experience.
• Experience working within Azure environments.
• Strong SQL skills and understanding of modern data engineering principles.

• Python and PySpark development.
• AWS services including EMR, S3, Lambda, Athena, and Redshift.
• Apache Spark and large-scale batch processing.
• Terraform, CI/CD pipelines, and Infrastructure as Code.
• Git/GitLab and modern software development practices.
• API integration and data services.
• Data warehousing, dimensional modelling, and dbt.
• Power BI familiarity.
• Experience working within government or highly regulated environments.

• Opportunity to work on impactful, large-scale data programmes.
• Exposure to modern cloud and data technologies.
• Collaborative and supportive engineering culture.
• Ongoing professional development and certification opportunities.
• Flexible working arrangements and excellent career progression opportunities.

If you're passionate about building scalable cloud data solutions and want to work on complex, high-profile programmes, we'd love to hear from you.

If this Data Engineer role is of interest, apply now or email your CV to me at (url removed)