Expansion of Global and Dense Open Embeddings Dataset of Earth ๐
We updated our previous embeddings release with three models MMEarth and DeCUR-S2, DeCUR-S1 of the Major TOM embeddings dataset, developed in collaboration with CloudFerro S.A. asterisk labs and ฮฆ-lab, European Space Agency - ESA. Together with @mikonvergence , Jฤdrzej S. Bojanowski, we extend the open-access collection of open dataset of Copernicus embeddings built at global scale, providing dense coverage across the entire acquisition area of Sentinel-1 and Sentinel-2 sensors.
Total embedding resources after the update: - 51 TB of AI-embeddings generated from processed Sentinel data, - over 40 billion embedding vectors, - processing of 147 TB of raw satellite data, - analysis covering more than 15 million Sentinel-1 and Sentinel-2 scenes and more than 16 trillion pixels.
This project delivers open and free vectorized expansions of Major TOM datasets available on CREODIAS and Hugging Face, setting a new standard for embedding releases and enabling lightweight, scalable ingestion of Earth Observation (EO) data for countless applications.
Today we release a prototype of COP-GEN - a universal generative model for Copernicus data. ๐๐๐-๐๐๐-๐๐๐ญ๐ is a model trained globally on the thumbnails of the Major TOM Core datasets, including Sentinel-2 L1C, Sentinel-2 L2A, Sentinel-1 RTC, and COP-DEM GLO-30.
How is it universal? COP-GEN learns a joint generative process of all modalities, which means that it can reconstruct data from any subset of present observations. ๐๐ข๐ญ๐ก๐จ๐ฎ๐ญ ๐ญ๐ซ๐๐ข๐ง๐ข๐ง๐ ๐ฌ๐ฉ๐๐๐ข๐๐ข๐๐๐ฅ๐ฅ๐ฒ to perform any of these tasks it can be used to approximate:
โ Sentinel-1 to Sentinel-2 translation
โ Elevation estimation from Sentinel-2 or Sentinel-1
โ Atmospheric Correction (L1C to L2A pipeline)
โ Atmospheric Generation (L2A to L1C)
โ ...and any other task involving translation between the supported modalities
On its own, the model can be used as a useful prior for estimating the data likelihood distribution for Copernicus data. COP-GEN-Beta learns joint, conditional, and marginal distributions within a single unified backbone, allowing to flexibly sample any modality given any condition.
Why is it Beta? Because thumbnails are a low-cost representation of the data that scales well and we managed to develop this prototype quite fast. We are currently developing the more costly COP-GEN model that supports the original data. For now, we wanted to showcase the prototype and make it available to the community for a test!
๐๐๐๐ ๐๏ธ ๐๐๐ฑ๐ญ-๐๐๐ฌ๐๐ ๐ญ๐๐ซ๐ซ๐๐ข๐ง ๐ ๐๐ง๐๐ซ๐๐ญ๐ข๐จ๐ง ๐ฆ๐จ๐๐๐ฅ MESA is a novel generative model based on latent denoising diffusion capable of generating 2.5D representations (co-registered colour and depth maps) of terrains based on text prompt conditioning.
Work developed by Paul BorneโPons (@NewtNewt) during his joint internship at Adobe & ESA, and in collaboration with asterisk labs.
First Global and Dense Open Embedding Dataset of Earth! ๐ ๐ค
Introducing the Major TOM embeddings dataset, created in collaboration with CloudFerro S.A. ๐ถ and ฮฆ-lab at the European Space Agency (ESA) ๐ฐ๏ธ. Together with @mikonvergence and Jฤdrzej S. Bojanowski, we present the first open-access dataset of Copernicus embeddings, offering dense, global coverage across the full acquisition areas of Sentinel-1 and Sentinel-2 sensors.
๐ก Highlights: ๐ Data: Over 8 million Sentinel-1 & Sentinel-2 images processed, distilling insights from 9.368 trillion pixels of raw data. ๐ง Models: Foundation models include SigLIP, DINOv2, and SSL4EO. ๐ฆ Scale: 62 TB of raw satellite data processed into 170M+ embeddings.
This project delivers open and free vectorized expansions of Major-TOM/README datasets, setting a new standard for embedding releases and enabling lightweight, scalable ingestion of Earth Observation (EO) data for countless applications.
