SNAP Data QA/QC

The qaqc_app_metadata.R script loads the meta.RData metadata workspace file used by the ar4ar5 QA/QC app. Final preparations of region and city data file path locations are completed. This new workspace is saved over the original.

R code

File path information for GCM and CRU 3.x files are finalized.

#### This is the final script run after all app data and metadata files are
#### compiled.  This is for final formatting related to regions and cities.

load("/workspace/UA/mfleonawicz/projects/SNAPQAQC/data/final/meta.RData")

topDir <- "/workspace/Shared/Users/mfleonawicz/qaqcAppData"

region.gcm.stats.path <- list.files(file.path(topDir, "region_files_GCM/stats"), 
    full = T)
region.gcm.stats.files <- lapply(region.gcm.stats.path, list.files, full = T)
region.cru.stats.path <- list.files(file.path(topDir, "region_files_CRU32/stats"), 
    full = T)
region.cru.stats.files <- lapply(region.cru.stats.path, list.files, full = T)

region.gcm.samples.path <- list.files(file.path(topDir, "region_files_GCM/samples"), 
    full = T)
region.gcm.samples.files <- lapply(region.gcm.samples.path, list.files, full = T)
region.cru.samples.path <- list.files(file.path(topDir, "region_files_CRU32/samples"), 
    full = T)
region.cru.samples.files <- lapply(region.cru.samples.path, list.files, full = T)
names(region.cru.stats.files) <- names(region.gcm.stats.files) <- names(region.cru.samples.files) <- names(region.gcm.samples.files) <- basename(region.gcm.stats.path)

File path information for GCM and CRU 3.x cities, and associated metadata, are finalized.

city.gcm.files.path <- file.path(topDir, "city_files_GCM")
city.gcm.files.2km <- list.files(file.path(city.gcm.files.path, "akcan2km"), 
    full = T)
city.gcm.files.10min <- list.files(file.path(city.gcm.files.path, "world10min"), 
    full = T)
city.cru.files.path <- file.path(topDir, "city_files_CRU32")
city.cru.files.2km <- list.files(file.path(city.cru.files.path, "akcan2km"), 
    full = T)
city.cru.files.10min <- list.files(file.path(city.cru.files.path, "world10min"), 
    full = T)
city.gcm.files <- city.gcm.files.10min  # using only 10-minute resolution files
city.cru.files <- city.cru.files.10min  # using only 10-minute resolution files

# city names to appear in app menu
city.names <- gsub("FSLASH", "/", gsub("PER", "\\.", gsub("APOS", "\\'", gsub("--", 
    ", ", sapply(strsplit(basename(city.gcm.files), "__"), "[[", 1)))))

# subset cities metadata data frame to match final files, same for all sets
cities.meta.file <- "/workspace/UA/mfleonawicz/projects/SNAPQAQC/data/final/cities_meta.RData"
load(cities.meta.file)
cities.meta <- subset(cities.meta, Location %in% city.names)
save(cities.meta, file = cities.meta.file)  # okay to save over original file
rm(cities.meta.file, topDir)

The meta.RData workspace used by the master QA/QC Shiny app is loaded and re-saved.

save.image(file.path("/workspace/UA/mfleonawicz/projects/SNAPQAQC/data/final/meta.RData"))