Founder

Vijay Singh

Data Engineer II at Amazon · 7 Years of Experience · Founder of D8Loop

I design and build data platforms end to end: pipelines, models, cloud infrastructure, monitoring, dashboards, and the judgment layer that makes systems trustworthy in production.

D8Loop is my proof of builder energy: a self-built interview lab shaped by Amazon-scale data engineering experience, hard work, and AI-assisted execution.

Contact Vijay View profile

Profile snapshot

Builder of production data systems and the product around them.

7 Years

of data engineering experience across production systems and builder-led product work

1-2 TB/day

financial reconciliation pipelines owned end to end

100%

data completeness and audit accuracy across transactions

Built beyond the job description

“D8Loop is not just a portfolio page. It is a working proof of how I build.”

Many data engineers can explain pipelines. I wanted to build the environment where people practice that thinking. So I designed and built D8Loop from scratch: the product, the interface, the practice flows, and the engineering foundation behind it.

Designed the product direction, information architecture, and premium interface language for D8Loop from scratch.

Built the website and practice workspaces end to end, combining frontend engineering, data-engineering domain knowledge, and product judgment.

Used AI tools deliberately as capability multipliers: faster iteration, sharper design review, stronger implementation discipline, and deeper self-learning.

Career history

2022 - Current

Data Engineer II

Amazon, India

Owns scalable financial data platforms, reconciliation pipelines, cloud infrastructure, monitoring, dashboards, and cross-functional solution design.

2019 - 2022

Data Engineer I

Amazon, India

Built Spark-based ETL pipelines on EMR, improved reliability, implemented data quality validations, and automated recurring operational tasks.

Measured impact

7 Years

of data engineering experience across production systems and builder-led product work

1-2 TB/day

financial reconciliation pipelines owned end to end

100%

data completeness and audit accuracy across transactions

30-45%

analytical query latency improvement for Finance teams

20-30%

annual storage and compute cost reduction through S3 + Athena

60%

reduction in operational incidents and manual support

Technical strengths

Cloud and data platforms

AWS CloudS3RedshiftAthenaEMRApache SparkAWS CDKBoto3IAMKMS

Engineering languages

PythonSQLScalaTypeScriptDockerGitCI/CD

Data systems

ETL / ELTData pipelinesData modelingWarehousingReconciliationPerformance tuning

Analytics and automation

QuickSightDashboardsReporting automationApache AirflowMonitoringSelf-recovery

AI and productivity

OpenAI SDKAI agentsChatbot integrationsn8n workflowsCursor AICopilot

Selected project impact

Production work, explained in plain impact.

The same skills behind D8Loop come from real systems: large-scale financial data, reliability tradeoffs, cost pressure, and the need to make complex work understandable.

Designed financial reconciliation pipelines end to end

Owned high-volume financial data flows from source understanding and transformation logic to audit-ready reporting.

Built scalable Redshift and S3 data models

Created Snowflake-style analytical models that made finance reporting faster, cleaner, and easier to reason about.

Reduced cost with Athena and Parquet optimization

Moved selected workloads from Redshift to S3 and Athena, cutting spend while preserving service-level expectations.

Optimized Spark jobs for peak-scale events

Improved EMR execution through executor sizing, partition tuning, and shuffle reduction during high-pressure business cycles.

Automated monitoring and self-recovery

Built CloudWatch and Lambda recovery patterns that reduced repeated manual support and improved operational confidence.

Created leadership dashboards from raw data to insight

Delivered QuickSight dashboards that turned monthly reporting from a manual cycle into a fast leadership view.

Education

Technical foundation plus data science growth.

MBA, Data Science - Amity University, Noida

Post Graduation, Internet of Things - CDAC-ACTS, Pune

B.Tech, Instrumentation - A.P.J Technical University, Noida

Recruiter contact

Want to discuss data engineering roles or interviews?

Reach out for opportunities related to data engineering, cloud data platforms, ETL architecture, analytics engineering, or AI-enabled data workflows.

vijaysngrajput@gmail.com

+91 9891673628

Amazon Data Engineer II