Data Engineer · Mid · Amazon

the posting, the skills it asks for, and the plan to get there

Amazon · amazon.jobs · checked today

Data Engineer, Amazon Music, Amazon Music Finance

Culver City, California, USAMid3+ yrsData Engineerposted 1 d ago

Amazon Music is an immersive audio entertainment service that deepens connections between fans, artists, and creators. From personalized music playlists to exclusive podcasts, concert livestreams to artist merch, Amazon Music is innovating at some of the most exciting intersections of music and culture. We offer experiences that serve all listeners with our different tiers of service: Prime members get access to all the music in shuffle mode, and top ad-free podcasts, included with their membership;

Skills, with evidence

  • Airflow / orchestration
    Construct resilient and scalable data pipelines using SQL/PySpark/Airflow to ingest, process, and transform substantial data volumes from diverse sources into a structured format, ensuring data quality and integrity.must have
  • Data modelling
    Develop data models to support business intelligence, delivering actionable insights and interactive reports to end-users.must have
  • Python
    Construct resilient and scalable data pipelines using SQL/PySpark/Airflow to ingest, process, and transform substantial data volumes from diverse sources into a structured format, ensuring data quality and integrity.must have
  • SQL
    Construct resilient and scalable data pipelines using SQL/PySpark/Airflow to ingest, process, and transform substantial data volumes from diverse sources into a structured format, ensuring data quality and integrity.must have
  • Warehousing
    Devise and implement an efficient, scalable data warehousing solution on AWS, utilizing appropriate NoSQL/SQL storage and database technologies for both structured and unstructured data.must have
  • AWS
    Engage in collaborative efforts with cross-functional teams — data scientists, business intelligence engineers, and Finance Managers — to architect a state-of-the-art data analytics platform on AWS using the AWS Cloud Development Kit (CDK).must have · not practised here
  • Machine learning
    Enable advanced analytics, machine learning, and generative AI capabilities within the platform, extracting predictive and prescriptive insights through tools like EMR and SageMaker.must have · not practised here
  • Spark
    Enable advanced analytics, machine learning, and generative AI capabilities within the platform, extracting predictive and prescriptive insights through tools like EMR and SageMaker.
  • Cost & performance
    Continuously monitor and optimize the performance of data pipelines, databases, and applications, ensuring low-latency data access for analytics and machine learning tasks.
  • Data quality
    Construct resilient and scalable data pipelines using SQL/PySpark/Airflow to ingest, process, and transform substantial data volumes from diverse sources into a structured format, ensuring data quality and integrity.
  • Failure handling
    Construct resilient and scalable data pipelines using SQL/PySpark/Airflow to ingest, process, and transform substantial data volumes from diverse sources into a structured format, ensuring data quality and integrity.
  • Streaming
    - Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
  • Governance & security
    Implement robust security measures and ensure data compliance with internal requirements, industry standards, and regulations to safeguard sensitive information.not practised here

Your plan

  1. The SQL screen: correct, then fast

    SQL · Data quality

    1 h
  2. 2 h
  3. Data modelling: the round most people fail

    Data modelling · Warehousing

    2 h
  4. Pipeline design: safe to run twice

    Airflow / orchestration · Failure handling · Streaming

    3 h
  5. 1 h
  6. 1 h
25 drills · Foundations + Intermediate10 hours

Not covered by the plan: AWS, Machine learning, Governance & security.

Readiness

Counted from drills you have completed anywhere on D8LooP.

leaves in 12 dremoved the moment Amazon closes it

Data Engineer, Amazon Music, Amazon Music Finance at Amazon: skills and prep plan · D8LooP