Data Platform Engineer
London (Hybrid)
6 Month Contract
£(Apply online only)/day (Inside IR35)
Data Platform Engineer needed with strong AWS cloud platform migration and Terraform expertise.
6 Month Rolling Contract based in London (Hybrid), with occasional travel to the Leeds office.
Hybrid Working - 3-4 days/week remote (WFH) + 1-2 days/week working from the office in London.
A chance to work with a leading global IT transformation business specialising in large-scale Government projects:
In-depth Data Engineering experience + AWS cloud data platform migration experience.
The role will focus on Data Engineering, cloud platform migration, infrastructure automation + supporting the delivery of large-scale data processing solutions.
Supporting a major Data platform modernisation programme including migration of data pipelines, notebooks + data workloads from legacy Databricks environment to modern AWS cloud-based data platforms.
Strong Terraform + Infrastructure as Code (IaC) skills including developing + maintaining Terraform code to support data platform deployments.
Supporting deployment of data platform components, jobs, permissions + environment configurations.
Analysing current Data Engineering solutions + identifying data migration requirements.
Onboarding datasets, users + workloads onto target platform.
Data Engineering: Python, PySpark, SQL, Data Pipeline Development, ETL/ELT Design, Data Modelling, Data Quality, Data Validation.
AWS Cloud Platform, S3, IAM, CI/CD concepts, DevOps principles, Agile Delivery.
Advantageous Skills: Databricks, Palantir Foundry, Foundry Pipeline Builder, Ontology concepts, Delta Lake, Secure Data Environment (SDE) experience, NHS / Healthcare data experience.
Government / (url removed) / Public Sector domain experience strongly preferred.
Must be active SC Cleared or fully eligible to undergo the full SC Security Clearance process
