{"accessLevel": "public", "bureauCode": ["010:12"], "contactPoint": {"@type": "vcard:Contact", "fn": "Megan K Hines", "hasEmail": "mailto:mhines@usgs.gov"}, "description": "This code base allows a user to provide a file of different configurations for running the Structural Topic Models, parallelizing its runs in Gitlab in a parallel matrix. \nThe interim and final outputs are pushed to Artifactory for archival storage and distribution. \nAttached Files: \n- stm-summaries-main.zip, the zipped code base for the cross validation gitlab pipeline \n- Dockerfile, a document with instructions used to create a container image \n- stm-summaries-main-File Manifest.csv, a list of the files contained in the zip file and their purpose\nRunning locally\nNote that these scripts are *primarily* provided for posterity purposes.\nTo run these scripts locally, you must copy processed article files into the `1_initial_article_text_cleaning/tagged_articles/` folder, in the form of `.rds` files.\nSee the \"Data prep and modeling support\" child on ScienceBase for more information on processing articles into the appropriate `.rds` format.\nRunning in GitLab if you import this codebase as a project:\n- browse to the Pipelines -> Click New Pipeline \n- Select File for variable type and then paste in a chunk of yml similar to the one below:\n`seed:` is the seed used to provide replication capabilities\n`train_prop:` is the proportion of the data set that should be withheld for training versus testing the model\n`K:` is the # of topics to ask the model to fit, a value of 0 is treated as a signal to the stm model to use the algorithm of Lee and Minmo to determine the proper K value\n`prevalence:` is the formula for the stm to use for introducing covariates into the stm model run. \nExample: \n~~~\n.snippet:\nmodel_parameters:\n- seed: \"20250514\"\ntrain_prop: \"0.75\"\nK: \"0\"\nprevalence: \"~ stm::s(quarter_ind) + water_quantity_ind + water_quality_ind + access_to_the_resource_ind + susceptibility_ind + coping_ind + exposure_ind + fire_ind + drought_ind + heat_ind + flood_ind + hab_ind\"\n- seed: \"20250514\"\ntrain_prop: \"0.75\"\nK: \"100\"\nprevalence: \"~ stm::s(quarter_ind) + water_quantity_ind + water_quality_ind + access_to_the_resource_ind + susceptibility_ind + coping_ind + exposure_ind + fire_ind + drought_ind + heat_ind + flood_ind + hab_ind\"", "distribution": [{"@type": "dcat:Distribution", "accessURL": "https://doi.org/10.5066/P144GSTD", "description": "Landing page for access to the data", "format": "XML", "mediaType": "application/http", "title": "Digital Data"}, {"@type": "dcat:Distribution", "description": "The metadata original format", "downloadURL": "https://data.usgs.gov/datacatalog/metadata/USGS.68af3ac2d4be0253bb2c804d.xml", "format": "XML", "mediaType": "text/xml", "title": "Original Metadata"}], "identifier": "http://datainventory.doi.gov/id/dataset/USGS_68af3ac2d4be0253bb2c804d", "keyword": ["USGS:68af3ac2d4be0253bb2c804d", "inlandWaters", "society"], "modified": "2026-07-10T00:00:00Z", "publisher": {"@type": "org:Organization", "name": "U.S. Geological Survey"}, "spatial": "-128.6719, 17.9787, -65.3906, 50.0642", "theme": ["geospatial"], "title": "Model Cross Validation Software and Pipeline"}