Amazon · amazon.jobs · checked today
Data Engineer , AWS Infrastructure Supply Chain Intelligence
AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on.
Skills, with evidence
- Data modelling
Experience with data modeling, warehousing and building ETL pipelines
must have - SQL
1+ years of SQL (Structured Query Language) experience
must have - AWS
Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
must have · not practised here - Python
Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Cost & performance
You’ll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers.
- Data quality
- Design and manage data audit, quality, and reconciliation processes in collaboration with various stakeholders.
- Spark
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Streaming
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Java
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
not practised here - Scala
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
not practised here
Your plan
- The SQL screen: correct, then fast≈ 1 h
SQL · Data quality
- Average order value by countryFoundations
- Line items per orderFoundations
- Revenue by buyer countryFoundations
- Customers who never orderedFoundations
- Hiring funnel by roleFoundations
- Python: the data-wrangling round≈ 2 h
Python
- Clean spreadsheet headers into column namesFoundations
- Events normalization jobFoundations
- List the distinct composite keysFoundations
- Deduplicate rows, first one winsFoundations
- Remove repeats from a sorted list of partitionsFoundations
- Data modelling: the round most people fail≈ 2 h
Data modelling
- Marketplace core entitiesFoundations
- Cinema seat bookingFoundations
- City parking baysFoundations
- Dating app matchesFoundations
- Food delivery ordersFoundations
- Pipeline design: safe to run twice≈ 4 h
Streaming
- Which day does it belong to?Foundations
- Parcel tracking pipelineIntermediate
- Five minutes behind the sourceIntermediate
- The source will not let youIntermediate
- The fact arrived firstIntermediate
- Spark: read the plan Spark actually ran≈ 1 h
Cost & performance · Spark
- HAVING vs WHERE: where does a filter after groupBy actually run?Foundations
- countDistinct vs approx_count_distinct: what the extra shuffle buysFoundations
- COUNT(*) vs COUNT(column): the null trapFoundations
- Grouping by two columns: what changes in the shuffle?Foundations
- Does the join type change the join strategy?Foundations
- Say it out loud≈ 1 h
25 drills · Foundations + Intermediate≈ 11 hours
Not covered by the plan: AWS, Java, Scala.
Readiness
Counted from drills you have completed anywhere on D8LooP.
leaves in 10 dremoved the moment Amazon closes it