mayo 7, 2025
~ 1 MIN
PANGAEA Benchmark now available in EOTDL
benchmark
datasets
models
pangaea
PANGAEA Benchmark now available in EOTDL
While geospatial foundation models (GFMs) have proliferated rapidly, their evaluations remain inconsistent and narrow. Existing works often utilize suboptimal downstream datasets (e.g., EuroSAT) and tasks (e.g., land cover classification), which constrain comparability and real-world usability. Additionally, a lack of diversity in evaluation protocols, including image resolution and sensor types, further complicates the extensive assessments of GFM performance.
To bridge this gap, PANGAEA emerges as a standardized evaluation protocol that incorporates a wide-ranging selection of datasets, tasks, resolutions, and sensor types, establishing a robust and widely applicable benchmark for GFMs.
Datasets
The PANGAEA Benchmark includes the following datasets:
- PASTIS-HD
- xView2
- crop-type-mapping-south-sudan
- Five-Billion-Pixels
- DynamicEarthNet
- sen1floods11
- SpaceNet7
- ai4smallfarms
- HLS-Burn-Scars
- MADOS-Marine-Debris-Oil-Spill
You can stage any of these datasets using the EOTDL CLI, for example:
eotdl datasets get PASTIS-HD --path .
Explore all the datasets in EOTDL selecting the PANGAEA
tag.
Learn more about the PANGAEA Benchmark in the official repository.
Models
Alongisde the benchmark datasets, we also provide a set of models already benchmarked.