Tide · job-boards.greenhouse.io · checked today
Lead Engineer, Data Platform
At Tide, we help SMEs save time and money in the running of their businesses by not only offering business accounts and related banking services, but also a comprehensive set of highly usable and connected administrative solutions, from invoicing to accounting. Tide is transforming the small business banking market and now supports over 2 million members globally across the UK, India, Germany and France. Using advanced technology, all solutions are designed with SMEs in mind.
Skills, with evidence
- Airflow / orchestration
Our data platform runs on GCP: BigQuery as our warehouse, Fivetran and event-driven ingestion, dbt, Apache Airflow (AWS MWAA), Looker, Atlan, Databricks, Terraform, GitHub, ConductorOne and Okta, Coralogix, and Claude for AI-assisted development.
must have - Cost & performance
Find the main cost drivers in data platforms and pipelines, and add guardrails and attribution that teams can act on.
must have - Data modelling
Solid data engineering fundamentals: batch and streaming ingestion, CDC and event-driven patterns, data modelling, and correctness (idempotency, ordering, late data, backfill).
must have - Data quality
Set SLOs, freshness and quality checks, and alerting that tells on-call what matters.
must have - Idempotency & backfills
Solid data engineering fundamentals: batch and streaming ingestion, CDC and event-driven patterns, data modelling, and correctness (idempotency, ordering, late data, backfill).
must have - Python
Strong production engineering in Python and SQL, including building and operating APIs, pipelines or shared libraries.
must have - SQL
Strong production engineering in Python and SQL, including building and operating APIs, pipelines or shared libraries.
must have - dbt
Our data platform runs on GCP: BigQuery as our warehouse, Fivetran and event-driven ingestion, dbt, Apache Airflow (AWS MWAA), Looker, Atlan, Databricks, Terraform, GitHub, ConductorOne and Okta, Coralogix, and Claude for AI-assisted development.
must have - Governance & security
Working knowledge of data governance in practice: PII masking, access control, residency, retention and lineage.
must have · not practised here - Terraform
Practical infrastructure as code (Terraform or equivalent) and CI/CD for data and infrastructure, including IAM across environments.
must have · not practised here - Failure handling
Set SLOs, freshness and quality checks, and alerting that tells on-call what matters.
- Streaming
Solid data engineering fundamentals: batch and streaming ingestion, CDC and event-driven patterns, data modelling, and correctness (idempotency, ordering, late data, backfill).
- GCP
We own how data is produced, moved, stored, modelled, governed and served across the UK, EU and India, on GCP with BigQuery at the core.
not practised here - Incremental loads
Solid data engineering fundamentals: batch and streaming ingestion, CDC and event-driven patterns, data modelling, and correctness (idempotency, ordering, late data, backfill).
Your plan
- The SQL screen: correct, then fast≈ 2 h
Data quality · SQL
- Airbnb: converting on a day with no published rateAdvanced
- Amazon: net revenue across two fan-outsAdvanced
- Build a percentile tableAdvanced
- Duplicate snapshot keysAdvanced
- Flag outlier ordersAdvanced
- Python: the data-wrangling round≈ 4 h
Python
- Data modelling: the round most people fail≈ 4 h
Data modelling · dbt
- Pipeline design: safe to run twice≈ 4 h
Airflow / orchestration · Idempotency & backfills · Failure handling · Streaming · Incremental loads
- Fourteen months of wrong numbersAdvanced
- Creator payout runAdvanced
- Delete me from everywhereAdvanced
- Realtime events pipelineAdvanced
- You fixed it. Who already used it?Advanced
- Spark: read the plan Spark actually ran≈ 2 h
Cost & performance
- applyInPandas per country: what Spark ships to Python, and the native rewriteAdvanced
- Filters you wrote in the wrong place: where Catalyst moves themAdvanced
- snappy, gzip or zstd: measure the Parquet codec trade-off yourselfAdvanced
- Find the four suspects in a slow pipeline (one of them is innocent)Advanced
- A filter after a window function: pushed down or not?Advanced
- Say it out loud≈ 1 h
25 drills · Advanced + Intermediate≈ 16 hours
Not covered by the plan: Governance & security, Terraform, GCP.
Readiness
Counted from drills you have completed anywhere on D8LooP.
leaves in 9 dremoved the moment Tide closes it