Tech Hub Β· Learning Paths

Visual roadmaps.
Click-to-track.

Structured learning paths for every major data engineering stack β€” each rendered as an interactive graph you can zoom, pan, and progress-track in your browser.

πŸ” Zoom & pan canvas
βœ… Track progress locally
πŸ’‘ Concepts per topic
πŸ“„ Curated resources
πŸ—ΊοΈ

Data Engineer β€” Junior to Senior

All levels
β†’

Storage, compute, orchestration, streaming, quality, cloud, and system design β€” everything needed to go from junior to senior data engineer.

SparkKafkadbtAirflowCloud
β–Έ7 sections
Β·~80h contentOpen roadmap β†’
Apache Spark

Apache Spark

Beginner β†’ Advanced
β†’

Master Spark's execution model, Catalyst optimizer, AQE, joins, Structured Streaming, and Kubernetes deployment. Goes beyond syntax β€” covers the why behind every performance decision.

SparkScalaPySparkStreamingPerformance
β–Έ5 sections
Β·~40h contentOpen roadmap β†’
Apache Kafka

Apache Kafka

Beginner β†’ Advanced
β†’

Deep dive into Kafka's storage model, consumer groups, replication, exactly-once semantics, Kafka Streams, ksqlDB, and production operations at scale.

KafkaStreamingKafka StreamsksqlDBEvent Sourcing
β–Έ4 sections
Β·~32h contentOpen roadmap β†’
SQL & Data Modeling

SQL & Data Modeling

Beginner β†’ Advanced
β†’

Window functions, recursive CTEs, query optimization, star/snowflake schema, SCDs, Data Vault, and modern Iceberg/Delta modeling.

SQLPostgreSQLData ModelingdbtSCD
β–Έ4 sections
Β·~28h contentOpen roadmap β†’
Python for Data Engineers

Python for Data Engineers

Beginner β†’ Senior
β†’

Type hints, async I/O, Pandas, Polars, DuckDB, Airflow DAGs, dbt Python models, testing with pytest, and packaging for production.

PythonPandasPolarsAirflowPytest
β–Έ4 sections
Β·~35h contentOpen roadmap β†’
πŸ—ΊοΈ

System Design for Data

Intermediate β†’ Senior
β†’

CAP theorem, consistency models, Lambda/Kappa/Lakehouse architectures, data mesh, event-driven systems, and real-world large-scale case studies.

System DesignDistributed SystemsData MeshLakehouseCAP Theorem
β–Έ4 sections
Β·~30h contentOpen roadmap β†’
Docker

Docker

Beginner β†’ Advanced
β†’

Master Docker from images and containers to multi-service orchestration with Compose. Covers networking, volumes, multi-stage builds, registries, and production hardening.

DockerContainersDevOpsCI/CDMicroservices
β–Έ5 sections
Β·~20h contentOpen roadmap β†’
Kubernetes

Kubernetes

Intermediate β†’ Senior
β†’

Complete Kubernetes roadmap covering architecture, workloads, networking, storage, security, and operations. Goes beyond kubectl to cover the control plane internals that matter for production.

KubernetesK8sDevOpsContainersCloud Native
β–Έ6 sections
Β·~45h contentOpen roadmap β†’
Terraform

Terraform

Beginner β†’ Advanced
β†’

Master Terraform HCL, providers, state management, modules, and CI/CD integration. Covers real-world patterns for managing multi-cloud infrastructure safely at scale.

TerraformIaCDevOpsAWSInfrastructure
β–Έ5 sections
Β·~25h contentOpen roadmap β†’
Apache Airflow

Apache Airflow

Beginner β†’ Advanced
β†’

Master Airflow from DAG basics to production-scale deployments. Covers operators, sensors, executors, dynamic DAGs, XComs, and Kubernetes integration for modern data engineering.

AirflowDAGsOrchestrationETLData Engineering
β–Έ5 sections
Β·~30h contentOpen roadmap β†’
πŸ—ΊοΈ

dbt Core

Beginner β†’ Advanced
β†’

Learn dbt from project setup to advanced incremental models, snapshots, and packages. The standard for modern analytics engineering workflows where data transformation happens inside the warehouse.

dbtAnalytics EngineeringSQLELTData Warehouse
β–Έ5 sections
Β·~25h contentOpen roadmap β†’
Apache Flink

Apache Flink

Intermediate β†’ Senior
β†’

Master Flink from DataStream API to Table API/SQL, windowing, exactly-once checkpointing, and production deployment on Kubernetes and YARN.

FlinkStreamingReal-timeDataStreamStateful
β–Έ5 sections
Β·~35h contentOpen roadmap β†’
Snowflake

Snowflake

Beginner β†’ Advanced
β†’

Master Snowflake's unique architecture, data loading patterns, SQL extensions, performance tuning, and data sharing capabilities. The leading cloud data warehouse for modern data teams.

SnowflakeData WarehouseSQLCloudData Engineering
β–Έ5 sections
Β·~28h contentOpen roadmap β†’
Databricks

Databricks

Intermediate β†’ Senior
β†’

Master Databricks from workspace basics to Delta Lake, Unity Catalog, MLflow, and production Spark deployments. The leading platform for lakehouse architecture implementation.

DatabricksDelta LakeSparkMLflowLakehouse
β–Έ5 sections
Β·~32h contentOpen roadmap β†’
πŸ—ΊοΈ

AWS Data Stack

Intermediate β†’ Senior
β†’

Master AWS data services: S3, Glue, Athena, Redshift, Kinesis, EMR, and Lake Formation. Build production-grade data lakes and pipelines using AWS-native tools.

AWSS3GlueRedshiftKinesis
β–Έ6 sections
Β·~40h contentOpen roadmap β†’
Google Cloud Data

Google Cloud Data

Intermediate β†’ Senior
β†’

Master Google Cloud data services: BigQuery, Dataflow, Pub/Sub, Dataproc, Cloud Storage, and Vertex AI. Build serverless analytics pipelines on GCP's best-in-class data platform.

GCPBigQueryDataflowPub/SubVertex AI
β–Έ5 sections
Β·~35h contentOpen roadmap β†’
πŸ—ΊοΈ

Azure Data Platform

Intermediate β†’ Senior
β†’

Master Azure data engineering with Synapse Analytics, Azure Data Factory, ADLS Gen2, Event Hubs, and Databricks. The enterprise data platform for Microsoft-first organizations.

AzureSynapseADFADLSEvent Hubs
β–Έ5 sections
Β·~35h contentOpen roadmap β†’
PostgreSQL

PostgreSQL

Beginner β†’ Advanced
β†’

Master PostgreSQL from SQL fundamentals to index internals, MVCC, query planning, advanced SQL features, and production administration. The world's most advanced open-source relational database.

PostgreSQLSQLDatabaseMVCCPerformance
β–Έ6 sections
Β·~35h contentOpen roadmap β†’
MongoDB

MongoDB

Beginner β†’ Advanced
β†’

Master MongoDB document modeling, CRUD, aggregation pipeline, indexes, replica sets, and sharding. The world's most popular document database for flexible schema data.

MongoDBNoSQLDocumentAggregationSharding
β–Έ5 sections
Β·~25h contentOpen roadmap β†’
Redis

Redis

Beginner β†’ Advanced
β†’

Master Redis data structures, persistence, pub/sub, Streams, Cluster, and production patterns. The most popular in-memory data store for caching, sessions, and real-time leaderboards.

RedisCachePub/SubStreamsCluster
β–Έ5 sections
Β·~20h contentOpen roadmap β†’
Elasticsearch

Elasticsearch

Intermediate β†’ Senior
β†’

Master Elasticsearch indexing, mapping, query DSL, aggregations, performance tuning, and production operations. The backbone of search, log analytics, and observability platforms.

ElasticsearchLuceneSearchELKOpenSearch
β–Έ5 sections
Β·~28h contentOpen roadmap β†’
Apache Cassandra

Apache Cassandra

Intermediate β†’ Senior
β†’

Master Cassandra data modeling, CQL, partitioning, consistency levels, and operations. The go-to database for IoT, time-series, and globally distributed workloads requiring linear scalability.

CassandraNoSQLWide-ColumnCQLDistributed
β–Έ5 sections
Β·~25h contentOpen roadmap β†’
Neo4j

Neo4j

Beginner β†’ Advanced
β†’

Master Neo4j graph modeling, Cypher query language, data import, performance tuning, and real-world applications in fraud detection, recommendations, and knowledge graphs.

Neo4jGraph DatabaseCypherKnowledge GraphFraud Detection
β–Έ5 sections
Β·~22h contentOpen roadmap β†’
ClickHouse

ClickHouse

Intermediate β†’ Senior
β†’

Master ClickHouse column-oriented storage, MergeTree engine family, SQL analytics, materialized views, performance tuning, and production operations for sub-second analytics at scale.

ClickHouseOLAPAnalyticsColumn StoreReal-time
β–Έ5 sections
Β·~22h contentOpen roadmap β†’
DuckDB

DuckDB

Beginner β†’ Advanced
β†’

Master DuckDB's columnar engine, rich SQL extensions, zero-copy Parquet/Arrow integration, and use as an embedded analytics engine in Python, R, and production pipelines.

DuckDBOLAPParquetArrowPython
β–Έ4 sections
Β·~15h contentOpen roadmap β†’
Trino

Trino

Intermediate β†’ Senior
β†’

Master Trino's architecture, SQL dialect, connector ecosystem, cost-based optimizer, and production deployment for federated analytics across data lakes and databases.

TrinoPrestoSQLFederated QueryData Lake
β–Έ5 sections
Β·~22h contentOpen roadmap β†’
Apache Iceberg

Apache Iceberg

Intermediate β†’ Senior
β†’

Master Apache Iceberg's table format specification, schema and partition evolution, catalog integration, row-level DML, and engine integration with Spark, Flink, and Trino.

IcebergData LakehouseOpen Table FormatACIDSchema Evolution
β–Έ5 sections
Β·~20h contentOpen roadmap β†’
Delta Lake

Delta Lake

Intermediate β†’ Senior
β†’

Master Delta Lake's transaction log, schema enforcement, DML operations, OPTIMIZE/Z-ORDER, Delta Sharing, and integration with Spark, Flink, and dbt for production lakehouse architectures.

Delta LakeACIDLakehouseSparkDatabricks
β–Έ5 sections
Β·~18h contentOpen roadmap β†’
πŸ—ΊοΈ

Machine Learning

Beginner β†’ Senior
β†’

Comprehensive ML roadmap covering math prerequisites, data preprocessing, core algorithms, model evaluation, feature engineering, and MLOps deployment. Built around scikit-learn with production best practices.

Machine LearningScikit-learnMLPythonData Science
β–Έ6 sections
Β·~60h contentOpen roadmap β†’
PyTorch & Deep Learning

PyTorch & Deep Learning

Intermediate β†’ Advanced
β†’

Build and train neural networks from mathematical foundations through production deployment. Covers CNNs, RNNs, Transformers, distributed training, and Hugging Face fine-tuning.

deep-learningmlpythonneural-networks
β–Έ6 sections
Β·~60h contentOpen roadmap β†’
MLflow & MLOps

MLflow & MLOps

Intermediate
β†’

Manage the full ML lifecycle with MLflow: experiment tracking, model registry, project packaging, and CI/CD pipelines for reliable model deployment.

mlopsmlpythondevops
β–Έ5 sections
Β·~30h contentOpen roadmap β†’
LangChain & LLM Apps

LangChain & LLM Apps

Intermediate β†’ Advanced
β†’

Build production LLM applications with LangChain and LangGraph: RAG pipelines, agents, tool use, memory, and observability with LangSmith.

llmaipythonragagents
β–Έ6 sections
Β·~35h contentOpen roadmap β†’
πŸ—ΊοΈ

Vector Databases

Intermediate
β†’

Store, index, and query high-dimensional embeddings for semantic search, RAG, and recommendation systems using Pinecone, Qdrant, Weaviate, and pgvector.

aimlembeddingssearch
β–Έ5 sections
Β·~20h contentOpen roadmap β†’
Pandas & NumPy

Pandas & NumPy

Beginner β†’ Intermediate
β†’

Master data wrangling and numerical computing with Pandas and NumPy β€” the foundational Python libraries for every data engineering and data science workflow.

pythondata-engineeringdata-scienceanalytics
β–Έ5 sections
Β·~25h contentOpen roadmap β†’
TypeScript

TypeScript

Beginner β†’ Advanced
β†’

Build type-safe applications at scale with TypeScript's structural type system, generics, utility types, and modern framework integrations.

frontendbackendjavascriptfullstack
β–Έ6 sections
Β·~30h contentOpen roadmap β†’
Go (Golang)

Go (Golang)

Beginner β†’ Advanced
β†’

Write concurrent, high-performance systems in Go: goroutines, channels, REST APIs, gRPC, and cloud-native tooling with a minimal runtime footprint.

backendsystemscloud-nativemicroservices
β–Έ6 sections
Β·~40h contentOpen roadmap β†’
Linux & Bash

Linux & Bash

Beginner β†’ Intermediate
β†’

Master the Linux command line and Bash scripting for system administration, automation, and DevOps β€” the universal foundation for server-side engineering.

devopssystemsbashinfrastructure
β–Έ5 sections
Β·~25h contentOpen roadmap β†’
Git & GitHub

Git & GitHub

Beginner β†’ Intermediate
β†’

Version control from commits and branches through advanced rebase, GitHub Actions CI/CD, and monorepo tooling β€” essential for every software engineer.

devopscollaborationci-cdtooling
β–Έ5 sections
Β·~15h contentOpen roadmap β†’
Prometheus & Grafana

Prometheus & Grafana

Intermediate
β†’

Implement full-stack observability with Prometheus metrics collection, PromQL queries, Alertmanager routing, and Grafana dashboards for production systems.

observabilitydevopsmonitoringsre
β–Έ5 sections
Β·~20h contentOpen roadmap β†’
FastAPI

FastAPI

Beginner β†’ Intermediate
β†’

Build high-performance async REST APIs in Python with FastAPI, Pydantic validation, dependency injection, SQLAlchemy, and production deployment patterns.

pythonbackendapiasync
β–Έ5 sections
Β·~20h contentOpen roadmap β†’
Apache Hadoop

Apache Hadoop

Intermediate
β†’

Understand Hadoop's distributed ecosystem β€” HDFS, YARN, MapReduce, Hive, and HBase β€” and how modern cloud lakehouses evolved from these foundations.

data-engineeringbig-datadistributed-systems
β–Έ5 sections
Β·~25h contentOpen roadmap β†’
GraphQL

GraphQL

Intermediate
β†’

Design and build flexible GraphQL APIs with type-safe schemas, efficient resolvers, Apollo Federation for microservices, and production security patterns.

apifullstackbackendfrontend
β–Έ5 sections
Β·~20h contentOpen roadmap β†’
Scala

Scala

Intermediate β†’ Advanced
β†’

Write type-safe functional programs and Spark jobs in Scala β€” combining JVM performance with FP abstractions, effect systems, and reactive streaming.

data-engineeringfunctional-programmingjvmspark
β–Έ5 sections
Β·~40h contentOpen roadmap β†’
Apache Superset

Apache Superset

Beginner β†’ Intermediate
β†’

Deploy Apache Superset for self-service analytics: connect 40+ databases, build interactive dashboards, and secure with RBAC and row-level security.

analyticsbidata-visualizationdashboards
β–Έ4 sections
Β·~15h contentOpen roadmap β†’
πŸ—ΊοΈ

Feature Engineering

Intermediate
β†’

Transform raw data into powerful ML features: numerical scaling, categorical encoding, text embeddings, time series lags, feature selection, and sklearn pipelines.

mldata-sciencepythonfeature-store
β–Έ5 sections
Β·~25h contentOpen roadmap β†’
πŸ—ΊοΈ

Data Visualization

Beginner β†’ Intermediate
β†’

Communicate data insights effectively with the right chart types, color theory, Matplotlib, Seaborn, Plotly, Dash, Tableau, Power BI, and D3.js.

data-scienceanalyticspythonbi
β–Έ5 sections
Β·~20h contentOpen roadmap β†’
πŸ—ΊοΈ

Great Expectations

Intermediate
β†’

Implement data quality pipelines with Great Expectations: write expectation suites, run checkpoint validations, generate Data Docs, and integrate with Airflow and dbt.

data-engineeringdata-qualitytestingpipelines
β–Έ4 sections
Β·~15h contentOpen roadmap β†’
Apache NiFi

Apache NiFi

Intermediate
β†’

Design and operate Apache NiFi data flows: ingest from any source, route and transform FlowFiles, version flows with NiFi Registry, and monitor in production.

data-engineeringetlstreamingno-code
β–Έ4 sections
Β·~20h contentOpen roadmap β†’
How it works
01

Explore the graph

Each roadmap is a zoomable, pannable D3 canvas. Sections and topics are visually connected so you see the full path at a glance.

02

Click any topic

Clicking a node opens a detail panel with a description, numbered key concepts, and curated resources β€” docs, books, tutorials.

03

Track your progress

Mark topics as done, in progress, or skipped. Progress is saved in localStorage β€” no account needed. Pick up where you left off.