PANGAEA Benchmark now available in EOTDL

benchmark

datasets

models

pangaea

PANGAEA Benchmark now available in EOTDL

While geospatial foundation models (GFMs) have proliferated rapidly, their evaluations remain inconsistent and narrow. Existing works often utilize suboptimal downstream datasets (e.g., EuroSAT) and tasks (e.g., land cover classification), which constrain comparability and real-world usability. Additionally, a lack of diversity in evaluation protocols, including image resolution and sensor types, further complicates the extensive assessments of GFM performance.

To bridge this gap, PANGAEA emerges as a standardized evaluation protocol that incorporates a wide-ranging selection of datasets, tasks, resolutions, and sensor types, establishing a robust and widely applicable benchmark for GFMs.

pangaea

Datasets

The PANGAEA Benchmark includes the following datasets:

You can stage any of these datasets using the EOTDL CLI, for example:

eotdl datasets get PASTIS-HD --path .

Explore all the datasets in EOTDL selecting the PANGAEA tag.

Learn more about the PANGAEA Benchmark in the official repository.

Models

Alongisde the benchmark datasets, we also provide a set of models already benchmarked.

< Blog