Volatiles are critical for understanding their delivery to the Moon and as a resource for sustained lunar exploration. Water ice and potentially other volatiles exist in and proximal to permanently shadowed regions (PSRs). However, little is known of the form, distribution, abundance, and stratigraphy of ice within the regolith. Lunar Trailblazer and the Volatiles Investigating Polar Exploration Rover (VIPER) aim to fill these knowledge gaps with observations at different scales. In this study, we replicated three different ice stratigraphies in a cryogenic, vacuum environment akin to that of PSRs, and measured the UV-Vis-NIR reflectance spectra before and after laser weathering the sample. Our findings reveal that near surface stratigraphy and weathering phenomena greatly affect detectability. Hence, results from our combined spectra and constructed regolith ice stratigraphy lays the groundwork for interpreting Lunar Trailblazer and VIPER results.