Problem Set
20 data engineering
challenges to solve.
Real-world problems spanning Spark, Kafka, SQL, Scala, system design, and cloud infrastructure. Each challenge includes starter code, test cases, and a built-in code editor.
Problem
Tags
Submissions
Difficulty
Find the Skewed Partition
Medium3,847 solved
SparkPartitioning3,847
Medium
Kafka Consumer Lag Simulator
Easy5,124 solved
KafkaMonitoring5,124
Easy
Design a Rate Limiter for a Data API
Hard1,290 solved
System Design
Redis
Redis1,290
Hard
SQL: Running Total with Gaps
Easy7,891 solved
SQLWindow Functions7,891
Easy
Implement a JSON Encoder Typeclass
Hard892 solved
ScalaType Classes892
Hard
Optimise a Slow Spark ETL Job
Medium2,341 solved
SparkAQETuning2,341
Medium
Design a Real-Time Event Pipeline
Hard1,087 solved
System DesignKafka
Kafka1,087
Hard
Write Great Expectations Suite
Easy4,218 solved
PythonTesting4,218
Easy
Kafka Connect S3 Sink Configuration
Easy3,210 solved
Kafka
AWS3,210
Easy
Spark Structured Streaming from Kafka
Medium2,145 solved
SparkKafkaStreaming2,145
Medium
SQL Query Optimisation — 10x Faster
Medium4,521 solved
SQLPerformance4,521
Medium
Build a Redis Streams Data Pipeline
Hard678 solved
RedisStreaming678
Hard
Airflow DAG Scheduling for ETL
Easy5,623 solved
AirflowETL5,623
Easy
Delta Lake Time Travel & Vacuum
Medium1,789 solved
SparkDelta Lake1,789
Medium
Terraform for Data Infrastructure
Hard934 solved
IaCAWS
Terraform
AWSTerraform934
Hard
Python ETL Pipeline with Pandas
Easy9,123 solved
PythonETL9,123
Easy
Scala Futures & Combinators
Medium1,456 solved
ScalaConcurrency1,456
Medium
Kafka Schema Registry with Avro
Medium2,034 solved
KafkaAvro2,034
Medium
dbt Data Transformation Models
Easy6,789 solved
SQL
dbtAnalytics6,789
Easy
Real-Time Dashboard with WebSockets
Hard456 solved
System DesignWebSockets
456
Hard
Free: 3 challenges/day.
Pro: Unlimited.
Upgrade to Pro for unlimited Code Arena access, detailed solution explanations, and skill certifications.
Unlock unlimited access →