Grab · api.smartrecruiters.com · checked today
Lead Data Infrastructure Engineer
Grab is Southeast Asia's leading superapp. From getting your favourite meals delivered to helping you manage your finances and getting around town hassle-free, we've got your back with everything. In Grab, purpose gives us joy and habits build excellence, while harnessing the power of Technology and AI to deliver the mission of driving Southeast Asia forward by economically empowering everyone, with heart, hunger, honour, and humility.
Skills, with evidence
- Airflow / orchestration
Workflow orchestration at production scale (Airflow, Dagster, Argo Workflows or similar).
must have - Data quality
Demonstrated ownership of data quality: validation frameworks, data contracts, tests, and alerting on the data itself — not only on job success.
must have - Python
Strong Python and SQL, with the ability to write production-grade data services rather than one-off scripts.
must have - SQL
Strong Python and SQL, with the ability to write production-grade data services rather than one-off scripts.
must have - Spark
Hands-on experience building and operating both batch and streaming pipelines (Spark, Flink, Kafka or equivalents).
must have - Warehousing
Data warehouse and lakehouse experience: open table formats (Iceberg, Delta, Hudi), partitioning strategy, and query engines (Presto/Trino, Spark SQL, BigQuery or equivalent).
must have - AWS
Cloud engineering on Alibaba Cloud (Aliyun) and/or AWS, including object storage at scale, with Terraform as the primary IaC tool.
must have · not practised here - Kubernetes
Docker and Kubernetes for building and running data workloads.
must have · not practised here - Terraform
Cloud engineering on Alibaba Cloud (Aliyun) and/or AWS, including object storage at scale, with Terraform as the primary IaC tool.
must have · not practised here - Cost & performance
Build observability for the pipelines themselves: throughput, lag, cost, failure modes and clear on-call signals.
- Failure handling
You will own the pipelines that move it, the validation and monitoring that prove it is trustworthy, the dashboards that engineering, operations and data science work from, and the integration of our robotics data and ML workloads onto Grab's existing data and ML platforms, so the team inherits Grab-scale tooling instead of rebuilding it.
- Dashboards & BI
You will own the pipelines that move it, the validation and monitoring that prove it is trustworthy, the dashboards that engineering, operations and data science work from, and the integration of our robotics data and ML workloads onto Grab's existing data and ML platforms, so the team inherits Grab-scale tooling instead of rebuilding it.
not practised here - Streaming
Design, build and operate batch and streaming pipelines for robot telemetry, sensor recordings, autonomy events and operational data.
- Schema evolution & contracts
Demonstrated ownership of data quality: validation frameworks, data contracts, tests, and alerting on the data itself — not only on job success.
Your plan
- The SQL screen: correct, then fast≈ 2 h
Data quality · SQL
- Airbnb: converting on a day with no published rateAdvanced
- Amazon: net revenue across two fan-outsAdvanced
- Build a percentile tableAdvanced
- Duplicate snapshot keysAdvanced
- Flag outlier ordersAdvanced
- Python: the data-wrangling round≈ 4 h
Python
- Data modelling: the round most people fail≈ 4 h
Warehousing
- Pipeline design: safe to run twice≈ 4 h
Airflow / orchestration · Failure handling · Streaming · Schema evolution & contracts
- Spark: read the plan Spark actually ran≈ 2 h
Spark · Cost & performance
- applyInPandas per country: what Spark ships to Python, and the native rewriteAdvanced
- Filters you wrote in the wrong place: where Catalyst moves themAdvanced
- snappy, gzip or zstd: measure the Parquet codec trade-off yourselfAdvanced
- A correlated COUNT(*) subquery: the join Spark runs, and the count bug it avoidsAdvanced
- Find the four suspects in a slow pipeline (one of them is innocent)Advanced
- Say it out loud≈ 1 h
Not covered by the plan: AWS, Kubernetes, Terraform, Dashboards & BI.
Readiness
Counted from drills you have completed anywhere on D8LooP.
leaves in 2 dremoved the moment Grab closes it
