Capital One · capitalone.wd12.myworkdayjobs.com · checked today
Data Engineer 5 - Enterprise Risk Management
Data Engineer 5 - Enterprise Risk Management Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive and iterative delivery environment?
Skills, with evidence
- Data modelling
At least 2 years of experience in data modeling and designing end-to-end data solutions using both relational and non-relational database systems
must have - Python
At least 4 years of experience programming with at least one of the following languages: Python, Java, or Scala
must have - SQL
At least 4 years of experience with SQL
must have - Spark
5+ years of hands-on experience designing, deploying and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
must have - Warehousing
5+ years of experience designing and supporting data warehousing solutions (e.g., Snowflake, Redshift)
must have - AWS
5+ years of hands-on experience designing, deploying and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
not practised here - Azure
5+ years of hands-on experience designing, deploying and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
not practised here - GCP
5+ years of hands-on experience designing, deploying and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
not practised here - Airflow / orchestration
3+ years of experience working on data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
- Java
At least 4 years of experience programming with at least one of the following languages: Python, Java, or Scala
not practised here - Scala
At least 4 years of experience programming with at least one of the following languages: Python, Java, or Scala
not practised here - Data quality
3+ years of experience working on data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
- Streaming
5+ years of experience designing, implementing, and operating real-time or streaming data pipelines
- Governance & security
Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws.
not practised here
Your plan
- The SQL screen: correct, then fast≈ 1 h
SQL · Data quality
- Average order value by countryFoundations
- Line items per orderFoundations
- Revenue by buyer countryFoundations
- Customers who never orderedFoundations
- Hiring funnel by roleFoundations
- Python: the data-wrangling round≈ 2 h
Python
- Clean spreadsheet headers into column namesFoundations
- Events normalization jobFoundations
- List the distinct composite keysFoundations
- Deduplicate rows, first one winsFoundations
- Render a byte count for humansFoundations
- Data modelling: the round most people fail≈ 2 h
Data modelling · Warehousing
- Marketplace core entitiesFoundations
- Cinema seat bookingFoundations
- City parking baysFoundations
- Dating app matchesFoundations
- Food delivery ordersFoundations
- Pipeline design: safe to run twice≈ 3 h
Airflow / orchestration · Streaming
- After the first one finishesFoundations
- Run it for last TuesdayFoundations
- The history nobody keptFoundations
- The spreadsheet is a dependencyFoundations
- Too slow by morningFoundations
- Spark: read the plan Spark actually ran≈ 1 h
Spark
- HAVING vs WHERE: where does a filter after groupBy actually run?Foundations
- countDistinct vs approx_count_distinct: what the extra shuffle buysFoundations
- COUNT(*) vs COUNT(column): the null trapFoundations
- Grouping by two columns: what changes in the shuffle?Foundations
- Does the join type change the join strategy?Foundations
- Say it out loud≈ 1 h
25 drills · Foundations + Intermediate≈ 10 hours
Not covered by the plan: AWS, Azure, GCP, Java, Scala, Governance & security.
Readiness
Counted from drills you have completed anywhere on D8LooP.
leaves in 12 dremoved the moment Capital One closes it