Multi-sensory Earth Science
Pair EIC visual frames with audio so users can perceive planetary change through both sight and sound.
[ NASA Space Apps Challenge · 2026 ]
Translating NASA's Earth Science visualizations into sound — turning our changing planet into a multi-sensory experience for everyone.
─── 01 · The Challenge ───
NASA's Earth Information Center produces stunning visualizations of our changing planet — but visualization alone limits who can reach it. The challenge invites us to make complex Earth science accessible, engaging, and multi-sensory by translating sight into sound.
Pair EIC visual frames with audio so users can perceive planetary change through both sight and sound.
Use the Web Audio API to translate Earth observation data into meaningful, interactive sound as frames change.
Reach audiences who benefit from audio-first or audio-supported interfaces, including blind and low-vision users.
─── 02 · Our Approach ───
We're building a working interface that pairs Earth Information Center visual frames with dynamic, real-time sonifications. A user sees a frame on screen — and hears a sound world built from it.
Frame as input. Each EIC visualization is a snapshot of Earth observation data with spatial and temporal structure.
Data to parameters. Pixel and metadata features are translated into audio parameters — pitch, timbre, density, motion — through the Web Audio API.
Sound as story. Real-time sonifications let users hear the planet's patterns unfold — engaging a sense often left out of Earth science communication.
─── 02.b · Our Toolkit ───
─── 03 · Our Team ───
We're a team of five engineering students and technology enthusiasts. Each of us contributes across the layers of the project — from data and audio to interface and machine learning — and we build it together.
CREW-01 · TEAM LEAD
Coordinates the Cosmic Cloud crew — keeping sight and sound aligned as the Earth Jukebox comes together.
CREW-02 · CREW
Brings the Jukebox to life through code, design, or research — depending on what the build needs.
CREW-03 · CREW
Contributes to the data, audio, and interface layers that turn Earth observation frames into sound.
CREW-04 · CREW
Helps shape the visualization, audio engine, or backend — wherever the Jukebox needs hands.
CREW-05 · CREW
Round out the team — contributing across the layers of the build as the prototype takes shape.
Read the full challenge brief on the official NASA Space Apps site.
▸ Open Challenge Brief