Essential Site Maintenance: Authorea-powered sites will be updated circa 15:00-17:00 Eastern on Tuesday 5 November.
There should be no interruption to normal services, but please contact us at [email protected] in case you face any issues.

loading page

Imaging Spectroscopy Processing Environment on the Cloud (ImgSPEC): A Prototype of an Open Science, Scalable Processing Environment
  • +13
  • E. Natasha Stavros,
  • Philip Townsend,
  • Hook Hua,
  • Sujen Shah,
  • Namrata Malarout,
  • Winston Olson-Duvall,
  • Marjorie Lucas,
  • William Phyo,
  • David Thompson,
  • Justin Merz,
  • Amruta Vidwans,
  • Adam Chlus,
  • Alexander Torres,
  • Dan Yu,
  • Michelle Gierach,
  • Kevin Marlis
E. Natasha Stavros
University of Colorado at Boulder

Corresponding Author:[email protected]

Author Profile
Philip Townsend
University of Wisconsin
Author Profile
Hook Hua
Jet Propulsion Laboratory, California Institute of Technology
Author Profile
Sujen Shah
Jet Propulsion Laboratory, California Institute of Technology
Author Profile
Namrata Malarout
NASA Jet Propulsion Laboratory
Author Profile
Winston Olson-Duvall
Jet Propulsion Laboratory, California Institute of Technology
Author Profile
Marjorie Lucas
Jet Propulsion Laboratory
Author Profile
William Phyo
Jet Propulsion Laboratory, California Institute of Technology
Author Profile
David Thompson
Jet Propulsion Laboratory, California Institute of Technology
Author Profile
Justin Merz
University of California Davis
Author Profile
Amruta Vidwans
University of Wisconsin Madison
Author Profile
Adam Chlus
University of Wisconsin-Madison
Author Profile
Alexander Torres
NASA Jet Propulsion Laboratory
Author Profile
Dan Yu
NASA Jet Propulsion Laboratory
Author Profile
Michelle Gierach
Jet Propulsion Laboratory, California Institute of Technology
Author Profile
Kevin Marlis
NASA Jet Propulsion Laboratory
Author Profile

Abstract

Imaging spectroscopy data is becoming more readily available from different satellite and airborne platforms. As this data becomes more prolific, there is a need for shared data tools and code for wrangling, cleaning, and analyzing it. The geospatial Imaging Spectroscopy Processing Environment on the Cloud (ImgSPEC) pioneers an on-demand science data processing platform with scalable back-end compute. It considers user experience and facilitates open science. ImgSPEC enables users to create data products in areas of interest using default workflows from registered algorithms, while also enabling users to customize scripts and workflows. ImgSPEC seamlessly interfaces with NASA Earthdata Search and tracks appropriate metadata for reproducibility when generating data products to share with others. Users can work in their preferred workspace (e.g., Rstudio, Jupyterlab, or command line) thereby facilitating use of open science software packages and collaborative coding through Git. ImgSPEC leverages existing NASA-funded information technologies such as the hybrid on-premise/cloud science data system (HySDS) and the Multi-mission Algorithm and Analysis Platform (MAAP). It also creates seamless interfaces with NASA-funded ECOSIS – a crowd-sourced spectral database, and ECOSML – a crowd-sourced model database. We demonstrate ImgSPEC on the Terrestrial Ecosystem use case processing through to foliar traits and fractional cover, thus aligning with driving thrusts for the NASA Surface Biology and Geology (SBG) Science and Applications Communities. As this technology is more widely adopted the interface with Amazon Web Services and NASA Earthdata search will enable broader use of more data (publicly available or loaded by the user) across more domains.