Blog/Cloud
dTechStack · Cloud
In-depth technical analysis

The Modern AWS Data Stack in 2026: Services, Patterns, and Costs

dT
dTechStack Team
Apr 29, 2026
12 min read·Cloud
AWSData StackS3RedshiftEMR

S3 as the foundation, Glue for ETL, EMR for Spark, Redshift for warehousing — with real cost benchmarks.

📬 Weekly Newsletter

Get one deep-dive article every Saturday. No spam. Unsubscribe anytime.

S3GluePROCESSEMRRedshiftServerlessOutputQuickSightIAM · VPC · KMS

AWS has the most mature set of managed data services of any cloud provider. The challenge isn't finding a service — it's choosing the right combination and understanding how costs compound. This is a practical guide to what the modern AWS data stack looks like, what it costs, and when to choose each service.

The Foundation: S3

Every AWS data platform starts with S3. It's the cheapest, most durable object storage on the planet — 11 nines of durability, $0.023/GB/month.

Key design decisions:

  • Partition by date: `s3://bucket/events/year=2026/month=05/day=08/`
  • Use Parquet or ORC, never CSV at scale
  • Set lifecycle rules: move to S3-IA after 30 days, Glacier after 90
  • Processing: Glue vs EMR

    Use Glue when: Simple ETL, no cluster management, infrequent jobs.

    Use EMR when: Fine-grained Spark config, long-running jobs, cost matters (EMR Spot is 70% cheaper than Glue).

    EMR Serverless is the middle ground: Spark on demand with no cluster management.

    ⚡dTechStack Pro

    Get unlimited access to all Cloud tutorials & animated diagrams

    1,000+ animated tutorials · 100+ AI tools · Mock interviews · Certifications

    Try Pro free →

    Real Cost Benchmark: 10TB/day Pipeline

    | Service | Monthly Cost |

    |---|---|

    | S3 Storage (90 days, 900TB) | ~$20,000 |

    | Kinesis Firehose | ~$900 |

    | EMR on Spot (8 r5.4xlarge × 6h/day) | ~$1,200 |

    | Athena (5TB scanned/day) | ~$750 |

    | Redshift RA3 (ra3.4xlarge × 2) | ~$2,500 |

    | **Total** | **~$25,350/month** |

    With S3 Intelligent-Tiering, Spot, and partition pruning, this drops to ~$14,000/month.

    Cost Optimization Priorities

  • **Compress and convert to Parquet first.** CSV → Parquet reduces S3 storage by 70% and Athena query cost by 90%.
  • **Use Spot for EMR task nodes.** 60–70% savings.
  • **Partition aggressively.** Athena skips entire partitions that don't match.
  • **Set Redshift auto-suspend.** Auto-suspend after 10 min saves 80% compute cost.
  • **Use S3 lifecycle rules.** Move to S3-IA after 30 days — 40% cost reduction.
  • ⚡dTechStack Pro

    Get unlimited access to all Cloud tutorials & animated diagrams

    1,000+ animated tutorials · 100+ AI tools · Mock interviews · Certifications

    Try Pro free →
    dT
    dTechStack Team
    Data Engineering · dTechStack Ventures · Bengaluru

    Related articles