We're seeking an experienced Senior Data Engineer to join a leading global organisation on a contract basis, helping to design and deliver scalable, enterprise-grade data solutions.
This role will focus on building and optimising modern data platforms using Python, Databricks and Spark, enabling advanced analytics, reporting and data-driven innovation across the business.
Client Details
Our client is a leading international financial institution with a long-established presence across major global markets. Serving a diverse client base that includes corporates, financial institutions and investors, the organisation delivers a broad range of banking, financing and capital markets services.
With significant investment in digital transformation and data-led innovation, the organisation is modernising its technology estate and expanding its enterprise data capabilities. Data plays a critical role in supporting business operations, regulatory obligations, analytics and strategic decision-making, making this an exciting opportunity to contribute to large-scale, business-critical data initiatives within a complex global environment.
Description
- Design, build and maintain scalable data pipelines using Python and Databricks
- Develop and optimise ETL/ELT processes leveraging Spark and Delta Lake
- Create robust data models and data architectures within modern Lakehouse environments
- Implement and manage data workflows across the Databricks ecosystem
- Ensure data quality, governance, reliability and performance across platforms
- Optimise distributed data processing workloads at scale
- Collaborate closely with data scientists, analysts and stakeholders to support analytics and machine learning initiatives
- Implement monitoring, logging and alerting capabilities across data solutions
- Champion engineering best practices and mentor less experienced team members
Profile
You will bring:
- 10+ years' experience in Data Engineering
- Experience delivering data engineering solutions within Banking, Financial Services, Capital Markets, Insurance, or other highly regulated enterprise environments.
- Strong hands-on expertise in Python
- Proven experience with Databricks, including notebooks, workflows, jobs and Delta Lake
- Strong knowledge of Apache Spark / PySpark
- Experience designing and delivering large-scale ETL/ELT pipelines
- Advanced SQL skills and experience with relational databases
- Experience working with cloud technologies such as AWS, Azure or GCP
- Knowledge of modern data warehousing platforms such as Snowflake, Redshift or BigQuery
- Understanding of data modelling principles and Lakehouse architecture
- Excellent communication, stakeholder management and problem-solving skills
Desirable experience includes:
- Databricks certifications
- Streaming technologies such as Kafka or Structured Streaming
- CI/CD and DevOps practices
- Docker and Kubernetes
- Exposure to machine learning pipelines
Job Offer
- Competitive day rate of £550-£880 Inside IR35 (Umbrella)
- Initial 6-month contract
- Hybrid working model with flexibility
- Opportunity to work on cutting-edge data engineering projects
- Exposure to modern cloud and data technologies
- Collaborative and high-performing engineering environment
- Chance to make a tangible impact on enterprise-scale data transformation initiatives