All_ops_data_files.txt S2Kops (SDops), xrayops, SolarApex IO files updated by cron jobs (Dave B, version Jun 20, 2008) Special notes: At the next upgrade to SIP (and associated java jar classes), a number of URL paths need to be changed, eg: There are a lot of non-public files in the terra1://~JB2006/SD_delivery_folder/ directory. There should only be the JB_delivery81_v3_9.txt, s2k_ap_hist.txt, and SolRes.dat.txt files. It appears these files are created by the S2Kops operations_folder using s2k_common_path_op.pro, which currently reads: path_SD = '/setusers/JB2006/Sites/SD_delivery_folder/' A /spacewx/dataIO/JB2006_SD/ folder should be created and set the path_SD to point to there. The S2KoutDelivery should be edited to transfer the JB_delivery81_v39.txt, s2k_ap_hist.txt, and SolRes.dat.txt files to the JB2006 website. As our SIP client apps are looking the the SD_delivery_folder, I shouldn't make the changes yet, but we should keep this in mind in the next update. All data ingest ----------------------------------------------------------------------------------------------------------------------- SWPC http://www.swpc.noaa.gov/ftpdir/latest/DSD.txt (Daily Solar Data) http://www.swpc.noaa.gov/ftpdir/indices/quar_DGD.txt (Daily Geomagnetic Data) http://www.swpc.noaa.gov/ftpdir/lists/radio/rad.txt (Solar Radio Data) http://www.swpc.noaa.gov/ftpdir/sbuv/NOAAMgII_Last_30_Days.dat (NOAA-16, deprecated) ftp helios.swpc.noaa.gov, /pub/sbuv/NOAAMgIIUnix.dat (NOAA-17) ftp://ftp.swpc.noaa.gov/pub/latest/45DF.txt (45 Day AP Forecast) Solstice,SEE, LASP ftp://laspftp.colorado.edu/pub/SEE_Data/spwx/latest_TIMED_SEE_obs.dat ftp://laspftp.colorado.edu/pub/SEE_Data/level3/see__L3_merged_YYYYDOY_VVV.ncdf ftp://laspftp.colorado.edu/pub/SEE_Data/spwx/YYYY_TIMED_SEE_obs.dat ftp laspftp.colorado.edu, /pub/solstice/sorce_solstice_mg2_index.txt MgII, NESDIS ftp dds.nesdis.noaa.gov, /pull/PRD.OZONE.1B.N17.Dyydoy.Shhmm.Ehhmm.Bxxxxx (primary Mg2 in MgII/mg2 database) ftp dds.nesdis.noaa.gov, /pull/GOME_M02_MGII_yyyymmdd F10.7, Penticton http://www.spaceweather.ca/latestflux_e.php F10.7, KP, NGDC ftp://ftp.ngdc.noaa.gov/STP/SOLAR_DATA/SOLAR_RADIO/FLUX/YYYY.OBS ftp://ftp.ngdc.noaa.gov/STP/SOLAR_DATA/SOLAR_RADIO/FLUX/YYYY.ADJ ftp://ftp.ngdc.noaa.gov/STP/GEOMAGNETIC_DATA/INDICES/KP_AP/YYYY.vXY SolarApex, SEM ftp://umtof.umd.edu/SEM/SEM_YY_DOY_MMDD.DAT http://sohowww.nascom.nasa.gov/data/ancillary/orbit/predictive/SO_OR_PRE_*.DAT IFM, SEC http://www.spacenv.com/~vince/ifm/tecDOYHHMM.plt http://www.spacenv.com/~vince/ifm/tecDOYHHMM.gif http://www.spacenv.com/~vince/ifm/muf3000/mufDOYHHMM.plt http://www.spacenv.com/~vince/ifm/muf3000/mufDOYHHMM.gif http://www.spacenv.com/~vince/ifm/FOF2/fofDOYHHMM.plt http://www.spacenv.com/~vince/ifm/FOF2/fofDOYHHMM.gif ACE, J.Retterer /setusers/jretterer/pbmod/gpdb/ ace_mag_1m.txt ace_swepam_1m.txt gpdbget.log rad.txt AK.txt ace_pkp_15m.txt DSTYYYYDOYHH.dat 27DO.txt DST, Japan http://wdc.kugi.kyoto-u.ac.jp/dst_realtime/YYYYMM/dstYYMM.for.request S2Kops, xrayops, SEM, SIP files for public or restricted access (via http://terra1.spacenvironment.net/~username/)----- ----------------------------------------------------------------------------------------------------------------------- SpaceWx.com website files created by S2Kops ----------------------------------------------------------------------- index.html data/ swdsNowcast.txt e107_nowcast.txt e107_nowcast.jpg e107_trend_plot.jpg s2k_webpage_1.jpg s2k_webtrend1.jpg s2k_1d_forecast.jpg s2k_spectrum.txt readme.txt terra1.spacenvironment.net files created by S2Kops for restricted access ------------------------------------------ /setusers/setusr/Sites/s2kpg_io/ swdsNowcast.txt s2kpg_v2_4monForecast.txt s2kpg_v2_hist_proxies.txt http://terra1.spacenvironment.net/~s2kops/index_terra1_s2kops.html (restricted, for monitoring operations) ------------ s2k_ToeTagger.log /setusers/s2kops/Sites/logs/ ArchiveProxyData_deadman.log HistFileUpdater_deadman.log HourlySWDSarchive_deadman.log S2KoutDelivery_deadman.log S2KrecentReader_deadman.log cleanS2Kproducts_deadman.log manageS2kopsFiles_deadman.log outputSWDSnowcast_deadman.log s2kops_deadman.log scp_to_isp_deadman.log HistFile_deadman.log /setusers/s2kops/Sites/nowcast/ BestGuessMg2_plt.jpg Mg2_adj_predictor_plt.jpg MgII_BestGuess.dat.txt mg2_est.dat.txt e107_nowcast.jpg e107_trend.jpg swdsNowcast.txt /setusers/s2kops/Sites/current_files/ Mg2_adj_predictor_plt.jpg Mg2_allSats_plt.jpg Plot_NOAAMgII_dat_plt.jpg cur_nesdis_N17_mg2.jpg /setusers/s2kops/Sites/data NOAAMgII.dat.txt http://terra1 spacenvironment.net/~xrayops/ files for public access ----------------------------------------------- /setusers/xrayops/Sites/ FlaresIndex.html (page is created everay few minutes using s2k_flare_output files) dataio/ current_flareIndices.txt current_1minute.txt sflr_output_IONOPS.txt images/ s2k_flare_history.jpg s2k_flare_predict.jpg http://terra1 spacenvironment.net/~xrayops/ files for restricted SIPS servlet access ------------------------------ /setusers/JB2006/deliveryFlobs SET_xrays_YYYYMMDDHHMMSS_Indices.txt SET_xrays_YYYYMMDDHHMMSS_1min.txt sflr_output_IONOPS.txt SEM public output files ------------------------------------------------------------------------------------------- /setusers/semdata/Sites/data/ Daily_v3.day.txt YY_v3.day.txt YY_MM_DD_v3.15 current.15_sec_avg.txt current.daily.txt /setusers/semdata/Sites/plots/ plot_15sec_YYYYMMDDHHMMSS.jpg plot_15sec.jpg ---- caps_ops (sol) -------------------------------------------------------------------------------------------------- UPGRADE!!! dbouwer@sol.spacenvironment.net /soldat/projects/mstar/crontab.mstar retrieves all the real-time terra1 files for IPS meteostar in /Users/mstarclient/Sites: */7 * * * * /usr/bin/java -classpath .:/soldat/projects/mstar mstar_main > /soldat/projects/mstar/mstar_cron.log CAPS (caps_ops) ------------------------------------------------------------------------------------------------------ /setusers/caps_ops/Sites/ index.html Current_Solar_Geomag.html commStatus_Africa.html commStatus_EastAsia.html commStatus_Europe.html commStatus_NorthAmerica.html commStatus_NorthPole.html commStatus_Pacific.html commStatus_SEastAsiaAU.html commStatus_SouthAmerica.html commStatus_SouthPole.html commStatus_WestAsia.html IFM_data/ tec_DOY_YYYY_MM_DD_HH_MM_global.txt IFM_images/ tec_DOY_YYYY_MM_DD_HH_MM_global.gif current_files/ current_TEC_image.gif Africa_R.jpg Africa_R.jpg.big.jpg Africa_T.jpg Africa_T.jpg.big.jpg EastAsia_R.jpg EastAsia_R.jpg.big.jpg EastAsia_T.jpg EastAsia_T.jpg.big.jpg Europe_R.jpg Europe_R.jpg.big.jpg Europe_T.jpg Europe_T.jpg.big.jpg G10part_5m_cur.txt G11part_5m_cur.txt Global_R.jpg Global_R.jpg.big.jpg Global_T.jpg Global_T.jpg.big.jpg Global_forecast.jpg Global_forecast.jpg.big.jpg Mewe_flare_spectrum.jpg Mewe_flare_spectrum.jpg.big.jpg Mewe_flare_spectrum_daily.jpg Mewe_flare_spectrum_daily.jpg.big.jpg NorthAmerica_R.jpg NorthAmerica_R.jpg.big.jpg NorthAmerica_T.jpg NorthAmerica_T.jpg.big.jpg NorthPole_R.jpg NorthPole_R.jpg.big.jpg NorthPole_T.jpg NorthPole_T.jpg.big.jpg Pacific_R.jpg Pacific_R.jpg.big.jpg Pacific_T.jpg Pacific_T.jpg.big.jpg SEastAsiaAU_R.jpg SEastAsiaAU_R.jpg.big.jpg SEastAsiaAU_T.jpg SEastAsiaAU_T.jpg.big.jpg SouthAmerica_R.jpg SouthAmerica_R.jpg.big.jpg SouthAmerica_T.jpg SouthAmerica_T.jpg.big.jpg SouthPole_R.jpg SouthPole_R.jpg.big.jpg SouthPole_T.jpg SouthPole_T.jpg.big.jpg WestAsia_R.jpg WestAsia_R.jpg.big.jpg WestAsia_T.jpg WestAsia_T.jpg.big.jpg current_TEC_data.txt current_TEC_image.gif flare_caps1_status.txt flare_caps2_status.txt flare_caps3_status_Africa.txt flare_caps3_status_EastAsia.txt flare_caps3_status_Europe.txt flare_caps3_status_NorthAmerica.txt flare_caps3_status_NorthPole.txt flare_caps3_status_Pacific.txt flare_caps3_status_SEastAsiaAU.txt flare_caps3_status_SouthAmerica.txt flare_caps3_status_SouthPole.txt flare_caps3_status_WestAsia.txt flare_caps4_banner.txt forecast_index2.jpg forecast_index2.jpg.big.jpg s2k_flare_history.jpg s2k_flare_history.jpg.big.jpg s2k_flare_predict.jpg s2k_flare_predict.jpg.big.jpg sflr_output_IONOPS.txt status_dot.jpg JB2006 website files ------------------------------------------------------------------------------------------ /setusers/JB2006/Sites/indices/ JB_delivery81_v3_9.txt - one of these should be deprecated! /setusers/JB2006/Sites/SD_delivery_folder/ SD_F10.txt SD_deliveryAp_v3_9.txt SD_delivery81_v3_9.txt SD_delivery54_v3_9.txt s2k_ap_hist.txt JB_deliveryAp_v3_9.txt JB_delivery81_v3_9.txt - one of these should be deprecated! Indices_statistics_v3_9.txt FD_S10.txt FD_L11.txt FD_K12.txt FD_K11.txt FD_K10.txt FD_J10.txt FD_I10.txt FD_H10.txt FD_G10.txt FD_D10.txt FD_C10.txt FD_B19.txt FD_B18.txt FD_B17.txt FD_B16.txt FD_B15.txt FD_B14.txt FD_B13.txt FD_B12.txt FD_B11.txt FD_B10.txt FD_A10.txt SolRes.dat.txt SolRes.dat SD_S10.txt SD_M10.txt /soldat/projects/caps_ops/ run-time files-------------------------------------------------------------------------------- caps_ops_cron.log latency_log.txt idl_indxRun.log launch_s2k_flare.log xray_runtime.log launch_mk_flareInd.log CleanXayopsFiles_cron.log update_dailyIndices.log update_dailyIndices_xraycron.log IFM_data/ (past day, 15-min cadence) tec_DOY_YYYY_MM_DD_HH_00_global.txt ... IFM_images/ (past day, 15-min cadence) tec_DOY_YYYY_MM_DD_HH_MM_global.gif ... IFM_data_muf/ (past day, 15-min cadence) muf_DOY_YYYY_MM_DD_HH_MM_global.txt ... IFM_images_muf/ (past day, 15-min cadence) muf_DOY_YYYY_MM_DD_HH_MM_global.gif ... IFM_data_fof2/ (past day, 15-min cadence) fof_DOY_YYYY_MM_DD_HH_MM_global.txt ... IFM_images_fof2/ (past day, 15-min cadence) fof_DOY_YYYY_MM_DD_HH_MM_global.gif ... oneMinuteDatasets/ xrays_1minCurrent.txt xray_1minPlots/ current_dailyIndices.plt.ps.ps current_flareIndices.plt.ps xray_1min_webdata/ G10xr_1m.txt s2k_flare_code/ current_TEC_data.txt s2k_flare_history.jpg s2k_flare_predict.jpg s2kpg_proxies.txt Mewe_flare_spectrum_daily.jpg flare_alert.txt flare_banner.txt flare_caps1_status.txt flare_caps1_status_YYYMMDDHHMM.txt flare_effects.txt flare_features.txt flare_status.txt sflr_output.txt Global_forecast.jpg SouthPole_R.jpg SouthPole_T.jpg flare_caps2_status.txt flare_caps3_status_Africa.txt flare_caps3_status_EastAsia.txt flare_caps3_status_Europe.txt flare_caps3_status_NorthAmerica.txt flare_caps3_status_NorthPole.txt flare_caps3_status_Pacific.txt flare_caps3_status_SEastAsiaAU.txt flare_caps3_status_SouthAmerica.txt flare_caps3_status_SouthPole.txt flare_caps3_status_WestAsia.txt flare_caps4_banner.txt WestAsia_R.jpg WestAsia_T.jpg Africa_R.jpg Africa_T.jpg Europe_R.jpg Europe_T.jpg SouthAmerica_R.jpg SouthAmerica_T.jpg NorthAmerica_R.jpg NorthAmerica_T.jpg Pacific_R.jpg Pacific_T.jpg SEastAsiaAU_R.jpg SEastAsiaAU_T.jpg EastAsia_R.jpg EastAsia_T.jpg NorthPole_R.jpg NorthPole_T.jpg Global_R.jpg Global_T.jpg Google_R.jpg Google_T.jpg sflr_output_IONOPS.txt current_1minute.txt current_flareIndices.txt mfd.txt s2k_output_39.txt current_files/ flare_caps1_status.txt flare_caps2_status.txt flare_caps3_status_Africa.txt flare_caps3_status_EastAsia.txt flare_caps3_status_Europe.txt flare_caps3_status_NorthAmerica.txt flare_caps3_status_NorthPole.txt flare_caps3_status_Pacific.txt flare_caps3_status_SEastAsiaAU.txt flare_caps3_status_SouthAmerica.txt flare_caps3_status_SouthPole.txt flare_caps3_status_WestAsia.txt flare_caps4_banner.txt current_TEC_image.gif current_TEC_data.txt G11part_5m_cur.txt G11part_5m.txt Programs distributed with terra1_dist.jar that access data files ------------------------------------------------------ RequestSETxrayClient.java (http://terra1.spacenvironment.net:9006/sol/RequestSETxrayServlet_noThrd) GetRequestedXrayFiles.java (http://terra1.spacenvironment.net/setusers/JB2006/deliveryFlobs/SET_xrays_*.txt) XrayopsClient.java (http://terra1.spacenvironment.net/setusers/xrayops/Sites/dataio/current_flareIndices.txt) JB_81d_Ap_dataRetriever.java (http://terra1.spacenvironment.net/setusers/JB20006/SD_delivery_folder/JB_deliveryAp_v3_9.txt) JB_81d_dataRetriever.java (http://terra1.spacenvironment.net/setusers/JB20006/SD_delivery_folder/JB_delivery81_v3_9.txt) SD_81d_Ap_dataRetriever.java (http://terra1.spacenvironment.net/setusers/JB20006/SD_delivery_folder/SD_deliveryAp_v3_9.txt) SD_81d_dataRetriever.java (http://terra1.spacenvironment.net/setusers/JB20006/SD_delivery_folder/SD_delivery81_v3_9.txt) SEM_Daily_dataRetriever.java (http://terra1.spacenvironment.net/~semdata/data/Daily_v3.day.txt) SEM_generic_dataRetriever.java (http://terra1.spacenvironment.net/~semdata/data/YY_v3.day.txt) TIMED_SEE_gen_dataRetriever.java (ftp://laspftp.colorado.edu/pub/SEE_Data/spwx/latest_TIMED_SEE_obs.dat) TIMED_SEE_gen_latestRetriever.java (ftp://laspftp.colorado.edu/pub/SEE_Data/spwx/YYYY_TIMED_SEE_obs.dat) getSEMdaily.sh (Gets daily SEM data from sql database, starting from YYYYMMDD, writes to file Daily_SEM.txt) s2kops files retrieved daily by get_reset_URLfiles.java for solar_index_driver.pro ------------------------------------ http://www.swpc.noaa.gov/ftpdir/latest/DSD.txt http://www.swpc.noaa.gov/ftpdir/indices/quar_DGD.txt http://www.swpc.noaa.gov/ftpdir/lists/radio/rad.txt ftp://ftp.ngdc.noaa.gov/STP/SOLAR_DATA/SOLAR_RADIO/FLUX/2006.ADJ ftp://ftp.ngdc.noaa.gov/STP/SOLAR_DATA/SOLAR_RADIO/FLUX/2006.OBS ftp://ftp.ngdc.noaa.gov/STP/SOLAR_DATA/SOLAR_RADIO/FLUX/2007.ADJ ftp://ftp.ngdc.noaa.gov/STP/SOLAR_DATA/SOLAR_RADIO/FLUX/2007.OBS ftp://ftp.ngdc.noaa.gov/STP/SOLAR_DATA/GEOMAGNETIC_DATA/INDICES/KP_AP/2007.vXY ftp://laspftp.colorado.edu/pub/SEE_Data/spwx/2006_TIMED_SEE_obs.dat ftp://laspftp.colorado.edu/pub/SEE_Data/spwx/latest_TIMED_SEE_obs.dat ftp://laspftp.colorado.edu/pub/SEE_Data/level3/see__L3_merged_YYYYDOY_009.ncdf s2kops files updated by ~/operations idl code ------------------------------------------------------------------------- /spacewx/s2kops/main/operations_folder/Ap/ s2k_ap_hist.txt /spacewx/s2kops/main/operations_folder/F107/ 2007.txt /spacewx/s2kops/main/operations_folder/time_series_data/ susim_v19rx_mgii_index.ascii /spacewx/s2kops/main/operations_folder/dataio/ mfd.txt s2k_average_files.txt (empty file!) s2k_out_avg.txt sdfd.txt s2k_recent_proxies_hist.txt SD_delivery54_v3_9.tmp SD_delivery54_v3_9_forecast.txt SD_delivery81_v3_9.tmp SD_delivery81_v3_9_forecast.txt s2k_1_6mon.jpg s2k_2_6mon.jpg s2k_3_6mon.jpg s2k_e10_fcast.txt s2k_fcast_compare.jpg s2k_output_6mon.txt s2k_trend182.jpg s2k_tsi_6mon.txt s2k_validation_1_6mon.jpg s2k_validation_file_6mon.txt validate.sav s2k_1.jpg s2k_2.jpg s2k_3.jpg s2k_output.txt s2k_tsi.txt s2k_validation_1.jpg s2k_validation_file.txt s2k_webpage_3.jpg s2k_webtrend182.jpg s2k_1_4mon.jpg s2k_2_4mon.jpg s2k_3_4mon.jpg s2k_ops_input_v2_32.txt s2k_output_4mon.txt s2k_proxies_v2_32.txt s2k_tsi_4mon.txt s2k_validation_1_4mon.jpg s2k_validation_file_4mon.txt s2k_trend137.jpg s2k_webtrend137.jpg s2k_1_28dy.jpg s2k_2_28dy.jpg s2k_3_28dy.jpg s2k_output_28dy.txt s2k_trend28.jpg s2k_tsi_28dy.txt s2k_validation_1_28dy.jpg s2k_validation_file_28dy.txt s2k_webtrend28.jpg s2k_1_14dy.jpg s2k_2_14dy.jpg s2k_3_14dy.jpg s2k_output_14dy.txt s2k_trend13.jpg s2k_tsi_14dy.txt s2k_validation_1_14dy.jpg s2k_validation_file_14dy.txt s2k_webtrend13.jpg s2k_1_72hr.jpg s2k_2_72hr.jpg s2k_3_72hr.jpg s2k_output_72hr.txt s2k_trend4.jpg s2k_tsi_72hr.txt s2k_validation_1_72hr.jpg s2k_validation_file_72hr.txt s2k_webtrend4.jpg s2k_1_24hr.jpg s2k_2_24hr.jpg s2k_3_24hr.jpg s2k_nowcast.txt s2k_output_24hr.txt s2k_output_hist.txt s2k_spectrum.txt s2k_tsi_24hr.txt s2k_validate.txt s2k_validation_1_24hr.jpg s2k_validation_file_24hr.txt s2k_output_39.txt s2k_recent_proxies.txt s2k_recent_proxies_hist.txt s2k_trend1.jpg s2k_output_0.txt s2k_webpage_1.jpg s2k_webtrend1.jpg SD_tmp_proxies.txt current_epoch.txt s2k_tmp_proxies.txt 2007.new build.txt stime.txt SolRes.dat Ap_1975.jpg SD_delivery54_v3_9.txt SD_delivery81_v3_9.txt FD_S10.txt FD_S10_v3_9.txt FD_L11.txt FD_L11_v3_9.txt FD_K12.txt FD_K12_v3_9.txt FD_K11.txt FD_K11_v3_9.txt FD_K10.txt FD_K10_v3_9.txt FD_J10.txt FD_J10_v3_9.txt FD_I10.txt FD_I10_v3_9.txt FD_H10.txt FD_H10_v3_9.txt FD_G10.txt FD_G10_v3_9.txt FD_D10.txt FD_D10_v3_9.txt FD_C10.txt FD_C10_v3_9.txt FD_B19.txt FD_B19_v3_9.txt FD_B18.txt FD_B18_v3_9.txt FD_B17.txt FD_B17_v3_9.txt FD_B16.txt FD_B16_v3_9.txt FD_B15.txt FD_B15_v3_9.txt FD_B14.txt FD_B14_v3_9.txt FD_B13.txt FD_B13_v3_9.txt FD_B12.txt FD_B12_v3_9.txt FD_B11.txt FD_B11_v3_9.txt FD_B10.txt FD_B10_v3_9.txt FD_A10.txt FD_A10_v3_9.txt Central_order_v3_9.txt SD_S10.txt SD_Seuv_v3_9.txt SD_Seuv_v3_9A.txt SEE_rescale.dat Daily_SEM.txt K10.dat K11.dat K12.dat SEM_SEE_ratio.dat B16.dat B17.dat B18.dat B19.dat C10.dat D10.dat G10.dat H10.dat I10.dat J10.dat A10.dat B10.dat B11.dat B12.dat B13.dat B14.dat B15.dat L10.dat S10.dat SEE_data.dat solar2000_op_forecast/ forecast_date.txt s2k_for11yr.txt s2k_for14dy.txt s2k_for28dy.txt s2k_for4mon.txt s2k_for6mon.txt s2k_for72hr.txt s2k_now24hr.txt s2k_for55yr.txt s2k_all_data.jpg s2k_forecast.jpg s2k_for11yr.jpg s2k_for14dy.jpg s2k_for24hr.jpg s2k_for28dy.jpg s2k_for4mon.jpg s2k_for55yr.jpg s2k_for6mon.jpg s2k_for72hr.jpg OPScommon/ s2k_hist_proxies_v2_32.tmp s2k_hist_proxies_v2_32.txt s2k_hist_proxies.txt SD_F10.txt SD_F107_3_9.txt s2k_proxies_v2_32 SD_M10.txt SD_M10_v2_32.txt s2k_conversion_v2_32.txt s2k_f10_lya_v2_32.txt s2k_Mg2_v2_32.txt s2k_Mg10_convert_v2_32.txt s2k_ap_hist.txt s2kops files updated by S2Kops java code ------------------------------------------------------------------------------ /spacewx/s2kops/main/operations_folder/s2k_hist_proxies_v2_32.txt (updated hourly by S2Kops.java) /spacewx/s2kops/main/operations_folder/Ap/YYYY (from get_reset_URLfiles.java) /spacewx/s2kops/main/operations_folder/Ap/quar_DGD.txt (from get_reset_URLfiles.java) /spacewx/s2kops/main/operations_folder/F107/2006.obs (from get_reset_URLfiles.java) /spacewx/s2kops/main/operations_folder/F107/2006.adj (from get_reset_URLfiles.java) /spacewx/s2kops/main/operations_folder/F107/2007.obs (from get_reset_URLfiles.java) /spacewx/s2kops/main/operations_folder/F107/2007.adj (from get_reset_URLfiles.java) /spacewx/s2kops/main/operations_folder/F107/rad.txt (from get_reset_URLfiles.java) /spacewx/s2kops/main/operations_folder/F107/DSD.txt (from get_reset_URLfiles.java) /spacewx/s2kops/main/operations_folder/time_series_data/sorce_solstice_mg2_index.txt /spacewx/s2kops/main/operations_folder/time_series_data/NOAAMgII.dat (now created from mg2dbase code) /setusers/semdata/Sites/data/07_v3.day.txt copied to /spacewx/dataIO/SEM_folder/07_v3.day.txt /setusers/semdata/Sites/data/06_v3.day.txt copied to /spacewx/dataIO/SEM_folder/06_v3.day.txt /spacewx/dataIO/solar2000/latest_proxy_info.txt /spacewx/dataIO/solar2000/ArchivedProxies.txt /spacewx/dataIO/solar2000/data_backup/forecasts/ (past 3 days) s2k_YYYY_MM_DD_HH_MM_out_72hr.txt s2k_YYYY_MM_DD_HH_MM_trend28.jpg s2k_YYYY_MM_DD_HH_MM_tsi_72hr.txt s2k_YYYY_MM_DD_HH_MM_val_72hr.txt s2k_YYYY_MM_DD_HH_MM_valid_1_72hr.jpg /spacewx/dataIO/solar2000/data_backup/nowcasts/ (past 3 days) s2k_YYYY_MM_DD_HH_MM_out.txt s2k_YYYY_MM_DD_HH_MM_trend1.jpg s2k_YYYY_MM_DD_HH_MM_tsi.txt s2k_YYYY_MM_DD_HH_MM_val.txt s2k_YYYY_MM_DD_HH_MM_valid_1.jpg /spacewx/s2kops/sftp/mfdusr/forecast/ s2k_YYYY_MM_DD_HH_MM_valid_1_72hr.jpg s2k_YYYY_MM_DD_HH_MM_val_72hr.txt s2k_YYYY_MM_DD_HH_MM_tsi_72hr.txt s2k_YYYY_MM_DD_HH_MM_trend28.jpg s2k_YYYY_MM_DD_HH_MM_spect_2_72hr.jpg s2k_YYYY_MM_DD_HH_MM_solar_3_72hr.jpg s2k_YYYY_MM_DD_HH_MM_runStatus.txt s2k_YYYY_MM_DD_HH_MM_out_72hr.txt s2k_YYYY_MM_DD_HH_MM_FvsEc_1_72hr.jpg mfd_YYYY_MM_DD_HH_MM.txt /spacewx/s2kops/sftp/mfdusr/nowcast s2k_YYYY_MM_DD_HH_MM_FvsEc_1.jpg s2k_YYYY_MM_DD_HH_MM_out.txt s2k_YYYY_MM_DD_HH_MM_runStatus.txt s2k_YYYY_MM_DD_HH_MM_solar_3.jpg s2k_YYYY_MM_DD_HH_MM_spect_2.jpg s2k_YYYY_MM_DD_HH_MM_trend1.jpg s2k_YYYY_MM_DD_HH_MM_tsi.txt s2k_YYYY_MM_DD_HH_MM_val.txt s2k_YYYY_MM_DD_HH_MM_valid_1.jpg /spacewx/s2kops/sftp/mfdusr/nowcast_archive (past 3 days) s2k_YYYY_MM_DD_HH_MM_FvsEc_1.jpg s2k_YYYY_MM_DD_HH_MM_out.txt s2k_YYYY_MM_DD_HH_MM_runStatus.txt s2k_YYYY_MM_DD_HH_MM_solar_3.jpg s2k_YYYY_MM_DD_HH_MM_spect_2.jpg s2k_YYYY_MM_DD_HH_MM_trend1.jpg s2k_YYYY_MM_DD_HH_MM_tsi.txt s2k_YYYY_MM_DD_HH_MM_val.txt s2k_YYYY_MM_DD_HH_MM_valid_1.jpg /spacewx/s2kops/sftp/nowcast_archive s2k_YYYY_MM_DD_HH_MM_out.txt s2k_YYYY_MM_DD_HH_MM_trend1.jpg s2k_YYYY_MM_DD_HH_MM_tsi.txt s2k_YYYY_MM_DD_HH_MM_val.txt s2k_YYYY_MM_DD_HH_MM_valid_1.jpg /spacewx/s2kops/sftp/swds_nowcastArchive/ s2k-SWDSnowcast-YYYY_MM_DD_HH_MM.txt - Deprecated. In a future version of S2Kops this needs to be maintained automatically /spacewx/dataIO/solar2000/logs/ ArchiveProxyData_deadman.log HistFileUpdater_deadman.log HourlySWDSarchive_deadman.log S2KoutDelivery_deadman.log S2KrecentReader_deadman.log cleanS2Kproducts_deadman.log manageS2kopsFiles_deadman.log outputSWDSnowcast_deadman.log s2k_ToeTagger.log s2kops_deadman.log scp_to_isp_deadman.log /spacewx/dataIO/solar2000/ ArchivedProxies.txt latest_proxy_info.txt /spacewx/dataIO/solar2000/persistent_mfd_archive - Persistant archive, a file every hour, This needs to be maintained automatically!!! /spacewx/dataIO/xrays/current_1minute.txt /spacewx/dataIO/xrays/current_flareIndices.txt Files for distribution ------------------------------------------------------------------------------------------------ /spacewx/s2kops/sftp/swds/ readme_swds.txt s2k-SWDSnowcast-YYYY_MM_DD_HH_MM.txt (overwritten hourly) s2kSWDShourlyTable swdsNowcast.txt /spacewx/s2kops/sftp/forecast/ e107_forecast.jpg operations mysql database backups ------------------------------------------------------------------------------------ /spacewx/database/mysql_MgII.YYYYMMDD.gz /spacewx/database/mysql_goes_particles.YYYYMMDD.gz /spacewx/database/mysql_goes_xrays.YYYYMMDD.gz /spacewx/database/mysql_sem.YYYYMMDD.gz /spacewx/database/mysql_dst.rt.YYYYMMDD.gz s2kops files downloaded for mg2dbase processing ----------------------------------------------------------------------- http://www.swpc.noaa.gov/ftpdir/sbuv/NOAAMgII_Last_30_Days.dat ftp helios.swpc.noaa.gov, /pub/sbuv/NOAAMgIIUnix.dat (NOAA-17 Mg2, secondary Mg2 source in MgII/mg2 database) ftp laspftp.colorado.edu, /pub/solstice/sorce_solstice_mg2_index.txt (primary Mg2 in MgII/mg2 database) ftp dds.nesdis.noaa.gov, /pull/PRD.OZONE.1B.N17.Dyydoy.Shhmm.Ehhmm.Bxxxxx ftp dds.nesdis.noaa.gov, /pull/GOME_M02_MGII_yyyymmdd mg2dbase files created by Mg2_DB_main.java ---------------------------------------------------------------------------- /spacewx/dataIO/mg2/Mg2_adj_predictor_plt.jpg /spacewx/dataIO/mg2/Mg2_allSats_plt.jpg /spacewx/dataIO/mg2/NOAA_MgII_78_current.txt /spacewx/dataIO/mg2/mg2_est.dat.txt /spacewx/dataIO/mg2/GOM_Mg2_data.txt /spacewx/dataIO/mg2/SOL_Mg2_data.txt /spacewx/dataIO/mg2/N17_Mg2_data.txt /spacewx/dataIO/mg2/N16_Mg2_data.txt /spacewx/dataIO/mg2/mg2_2000_to_current.txt s2kops Input Files from remote sites (see mg2dbase for Mg2 files) ----------------------------------------------------- Deprecated: http://www.drao-ofr.hia-iha.nrc-cnrc.gc.ca/icarus/www/current_flux.shtml (now www.spaceweather.ca) http://www.spaceweather.ca/latestflux_e.php ftp://ftp.swpc.noaa.gov/pub/latest/45DF.txt ftp://ftp.ngdc.noaa.gov/STP/SOLAR_DATA/SOLAR_RADIO/FLUX/YYYY.OBS ftp://ftp.ngdc.noaa.gov/STP/GEOMAGNETIC_DATA/INDICES/KP_AP/YYYY ftp://laspftp.colorado.edu/pub/SEE_Data/level3/see__L3_merged_YYYYDOY_VVV.ncdf ftp://laspftp.colorado.edu/pub/SEE_Data/spwx/YYYY_TIMED_SEE_obs.dat ftp://laspftp.colorado.edu/pub/SEE_Data/spwx/latest_TIMED_SEE_obs.dat SEM input files ftp://umtof.umd.edu/SEM/SEM_YY_DOY_MMDD.DAT http://sohowww.nascom.nasa.gov/data/ancillary/orbit/predictive/SO_OR_PRE_*.DAT caps_ops Working Files ------------------------------------------------------------------------------------------------ /soldat/projects/caps_ops/current_files/current_TEC_data.txt /soldat/projects/caps_ops/current_files/current_TEC_image.txt /soldat/projects/caps_ops/IFM_images/tecYYYYDDDHHMM.gif /soldat/projects/caps_ops/IFM_data/tecYYYYDDDHHMM.plt nairas Working Files -------------------------------------------------------------------------------------------------- /soldat/projects/dataio/DST/ DST_RT_YYYY_MM.txt SEM ops intermediate files -------------------------------------------------------------------------------------------- /soldat/projects/dataio/SolarApexIO/current.15_sec_avg.txt /soldat/projects/dataio/SolarApexIO/current.daily.txt s2kops files created from downloads or S2Kops ------------------------------------------------------------------------- /spacewx/dataIO/penticton/pentictonHTML.dat (downloaded from Penticton site hourly) /spacewx/dataIO/penticton/testPentictonHTML.dat (created by S2Kops) /spacewx/dataIO/penticton/F10_est_3dy.dat (created by Make_3_14_DB_F10files and F10_predictor) /spacewx/dataIO/penticton/F10_est_14dy.dat (created by Make_3_14_DB_F10files and F10_predictor) /spacewx/dataIO/penticton/F10_predictor_plt.jpg (created by Make_3_14_DB_F10files and F10_predictor) /soldat/dataio/SEE_data_folder/SEM1_coef.txt (created by ~/operations_folder/*.pro) /soldat/dataio/SEE_data_folder/see_L3_merged.ncdf (downloaded?) /soldat/dataio/SEE_data_folder/2006_TIMED_SEE_obs.dat (downloaded?) /soldat/dataio/SEE_data_folder/2007_TIMED_SEE_obs.dat (downloaded?) /soldat/dataio/SEE_data_folder/latest_TIMED_SEE_obs.dat (downloaded?) S2Kops ~/operations_folder/solar_convert_sem2f10.pro creates --------------------------------------------------------- /spacewx/dataIO/SEM_folder/06_v3.day.txt /spacewx/dataIO/SEM_folder/07_v3.day.txt /spacewx/dataIO/SEM_folder/08_v3.day.txt /spacewx/dataIO/SEM_folder/Daily_v3.txt /spacewx/dataIO/SEM_folder/SEM0_coef.txt /spacewx/dataIO/SEM_folder/SEM1_coef.txt /spacewx/dataIO/SEM_folder/SEM1_correction_coef.txt /spacewx/dataIO/SEM_folder/Daily_SEM.txt /spacewx/dataIO/SEM_folder/S10.dat /spacewx/dataIO/SEM_folder/s2k_hist_proxies.txt s2kops nowcast files -------------------------------------------------------------------------------------------------- /spacewx/s2kops/sftp/nowcast/ s2k_YYYY_MM_DD_HH_MM_spect_2.jpg s2k_YYYY_MM_DD_HH_MM_trend1.jpg s2k_YYYY_MM_DD_HH_MM_out.txt s2k_YYYY_MM_DD_HH_MM_val.txt s2k_YYYY_MM_DD_HH_MM_solar_3.jpg e107_nowcast.jpg s2k_YYYY_MM_DD_HH_MM_tsi.txt s2k_YYYY_MM_DD_HH_MM_valid_1.jpg s2k_YYYY_MM_DD_HH_MM_FvsEc_1.jpg s2k_YYYY_MM_DD_HH_MM_runStatus.txt e107_trend_plot.jpg s2kops pg intermediate files. Deprecate? ------------------------------------------------------------------------------ /spacewx/s2kops/sftp/s2kpg_v2_data/ swdsNowcast.txt s2kpg_v2_hist_proxies.txt Restricted Web-accessible ops files ----------------------------------------------------------------------------------- /setusers/setusr/Sites/swdsNowcast.txt /setusers/setusr/Sites/s2kpg_v2_4monForecast.txt /setusers/setusr/Sites/s2kpg_v2_4monForecast.txt s2kops spacewx.com files (main web page updates every hour) ----------------------------------------------------------- /spacewx/s2kops/webData/index.html Note: /spacewx/s2kops/webData/latestNews.txt, a manually-edited static file, is imbedded into index.html Operational mySQL data tables ----------------------------------------------------------------------------------------- sem/sem_daily (persistant) sem/sem_daily (current day only) goes_xrays/goes (daily indices) goes_xrays/goes_imin licenses/solar2000 solar2000/users MgII/mg2 DST/rt goes_particles/GOES11 goes_particles/GOES10 (Operational mySQL data table, GOES10, off-line indefinitley, temporarily disabled?) Programs used for downloading real-time data -------------------------------------------------------------------------- /spacewx/s2kops/main/ get_reset_URLfiles.java (see below) /spacewx/s2kops/main/operations_folder/getSEMdaily.sh (accesses daily SEM YYYYMMDD files from database, writing to ~/operations_folder/Daily_SEM.txt ) /spacewx/s2kops/main/L3_FTP_Directory_parser.java /spacewx/s2kops/main/SEM_generic_dataRetriever.java /spacewx/s2kops/main/TIMED_SEE_dataRetriever.java /spacewx/s2kops/main/TIMED_SEE_gen_latestRetriever.java /spacewx/s2kops/main/ftp_NGDC_flux_dirList.java /spacewx/s2kops/main/ftp_getNGDC_Ap_files.java /spacewx/s2kops/main/ ftp_getNGDC_F10_files.java /spacewx/s2kops/main/ftp_getSolsticeMg2.java /spacewx/s2kops/main/get_xrayfiles.java /spacewx/s2kops/mg2dbase/FTP_getSWPC_mg2Helios.java /spacewx/s2kops/mg2dbase/FTP_getSolstice_mg2dbase.java /spacewx/s2kops/mg2dbase/FTP_get_NesdisGome.java /spacewx/s2kops/mg2dbase/FTP_get_NesdisN17.java /spacewx/s2kops/mg2dbase/Get_NOAA_Mg2files.java /soldat/projects/nairas/get_DST_realtime_page.java /soldat/projects/caps_ops/get_FOF2dataFiles.java /soldat/projects/caps_ops/get_FOF2imageFiles.java /soldat/projects/caps_ops/get_FOF2page.java /soldat/projects/caps_ops/get_GOESpartFiles.java /soldat/projects/caps_ops/get_IFMdataFiles.java /soldat/projects/caps_ops/get_IFMimageFiles.java /soldat/projects/caps_ops/get_IFMpage.java /soldat/projects/caps_ops/get_MUF3000dataFiles.java /soldat/projects/caps_ops/get_MUF3000imageFiles.java /soldat/projects/caps_ops/get_MUF3000page.java Deprecated ------------------------------------------------------------------------------------------------------------ http://www.swpc.noaa.gov/ftpdir/sbuv/NOAAMgII.dat (no longer created) ftp://spcusr:usrspc@ftp.spacewx.com/nowcast/nowcastSWDS.txt (no longer created) /spacewx/s2kops/main/operations_folder/time_series_data/sorce_solstice_mg2_index.txt (no longer created) /soldat/dataio/mg2/mg2HTML.dat (no longer created) /soldat/dataio/noaa16/mg2HTML.dat (no longer created) /spacewx/dataIO/solar2000/data_backup/hist_proxies/s2k_hist_proxies_emergency_backup.txt (no longer created) /spacewx/dataIO/solar2000/persistent_mfd_archive/ (THIS SHOULD BE DEPRECATED ASAP) sftp-enables spcusr (THIS SHOULD BE DEPRECATED ASAP) /setusers/spcusr/Sites/dataio/mfd.txt get_reset_URLfiles.java ----------------------------------------------------------------------------------------------- gets http://www.swpc.noaa.gov/ftpdir/latest/DSD.txt writes to /spacewx/s2kops/main/operations_folder/F107/DSD.txt gets http://www.swpc.noaa.gov/ftpdir/indices/quar_DGD.txt writes to /spacewx/s2kops/main/operations_folder/Ap/quar_DGD.txt gets http://www.swpc.noaa.gov/ftpdir/lists/radio/rad.txt writes to /spacewx/s2kops/main/operations_folder/F107/rad.txt gets F10 files from ftp.ngdc.noaa.gov, writing to (/spacewx/s2kops/main/operations_folder/F107/: from 2006.ADJ to 2006.adj from 2006.OBS to 2006.obs from 2007.ADJ to 2007.adj from 2007.OBS to 2007.obs gets Ap file (2007.vxy) from ftp.ngdc.noaa.gov writes to (/spacewx/s2kops/main/operations_folder/Ap/2007 gets http://terra1.spacenvironment.net/~semdata/data/07_v3.day.txt writes to /spacewx/dataIO/SEM_folder/07_v3.day.txt gets http://terra1.spacenvironment.net/~semdata/data/06_v3.day.txt writes to /spacewx/dataIO/SEM_folder/06_v3.day.txt gets ftp://laspftp.colorado.edu/pub/SEE_Data/spwx/2007_TIMED_SEE_obs.dat writes to /spacewx/dataIO/SEE_data_folder/2007_TIMED_SEE_obs.dat gets ftp://laspftp.colorado.edu/pub/SEE_Data/spwx/2006_TIMED_SEE_obs.dat writes to /spacewx/dataIO/SEE_data_folder/2006_TIMED_SEE_obs.dat gets ftp://laspftp.colorado.edu/pub/SEE_Data/spwx/latest_TIMED_SEE_obs.dat writes to /spacewx/dataIO/SEE_data_folder/latest_TIMED_SEE_obs.dat gets ftp://laspftp.colorado.edu/pub/SEE_Data/level3/see__L3_merged_2007357_009.ncdf writes to /spacewx/dataio/SEE_data_folder/see_L3_merged.ncdf caps_ops_main.java ------------------------------------------------------------------------------------------------------ calls xray_cronMaster.java calls GOESpart_main gets IFM data and images and writes to ~/IFM_data ~/IFM_images updates the /setusers/caps_ops/Sites/ pages and files duplicates all /setusers/caps_ops/Sites files to /setusers/ionops/Sites xray_cronMaster.java -------------------------------------------------------------------------------------------------- creates /soldat/projects/caps_ops/xray_1min_webdata/G11xr_1m.txt from SWPC site, used to fill mysql records creates /soldat/projects/caps_ops/oneMinuteDatasets/xrays_1minCurrent.txt from database for IDL programs to read runs writeFlarePage.java copies /soldat/projects/caps_ops/s2k_flare_code/current_1minute.txt (created by make_flareIndices.pro) to /setusers/xrayops/Sites/dataio/current_1minute.txt copies /soldat/projects/caps_ops/s2k_flare_code/current_flareIndices.txt (created by make_flareIndices.pro) to /setusers/xrayops/Sites/dataio/current_flareIndices.txt copies /soldat/projects/caps_ops/current_files/current_TEC_data.txt (created by get_IFMdataFiles.java) to /soldat/projects/caps_ops/s2k_flare_code/current_TEC_data.txt copies /spacewx/s2kops/main/operations_folder/dataio/mfd.txt to /soldat/projects/caps_ops/s2k_flare_code/mfd.txt runs s2k_flare_code/s2k_flare_master.pro copies /soldat/projects/caps_ops/s2k_flare_code/s2k_flare_predict.jpg to /setusers/xrayops/Sites/images/s2k_flare_predict.jpg copies /soldat/projects/caps_ops/s2k_flare_code/s2k_flare_history.jpg to /setusers/xrayops/Sites/images/s2k_flare_history.jpg copies /soldat/projects/caps_ops/s2k_flare_code/sflr_output.txt to /setusers/xrayops/Sites/dataio/sflr_output_IONOPS.txt runs /soldat/projects/caps_ops/make_dailyIndices.pro creating /soldat/projects/caps_ops/oneMinuteDatasets/xrays_1minCurrent.txt and /soldat/projects/caps_ops/S2K_flare_code/daily_flareIndices.txt' runs Update_dailyXrayDB.java runs update_capsops_files.java writeFlarePage.java --------------------------------------------------------------------------------------------------- creates /setusers/xrayops/Sites/FlaresIndex.html from file /setusers/xrayops/Sites/FlaresIndexMaster.html using: /soldat/projects/caps_ops/s2k_flare_code/flare_banner.txt /soldat/projects/caps_ops/s2k_flare_code/flare_alert.txt /soldat/projects/caps_ops/s2k_flare_code/flare_effects.txt /soldat/projects/caps_ops/s2k_flare_code/flare_features.txt copies /soldat/projects/caps_ops/s2k_flare_code/s2k_flare_history.jpg to /setusers/xrayops/Sites/images/s2k_flare_history.jpg copies /soldat/projects/caps_ops/s2k_flare_code/s2k_flare_predict.jpg to /setusers/xrayops/Sites/images/s2k_flare_predict.jpg GOESpart_main.java ---------------------------------------------------------------------------------------------------- gets from SWPC GOES files and writes to /soldat/projects/caps_ops/current_files/G11part_5m.txt updates database, creates /soldat/projects/caps_ops/current_files/G11part_5m_cur.txt calls Extract_goesPartDB.java, creating /soldat/projects/caps_ops/current_files/G11part_5m_cur.txt, /soldat/projects/caps_ops/current_files/G11part_5m_sql.txt, /soldat/projects/caps_ops/current_files/G11part_5m_sec.txt update_caps2ionops_files.java ----------------------------------------------------------------------------------------------- gets file listings in the /soldat/projects/caps_ops/current_files and s2k_flare_code directories (jpgs, flare caps, indices), copies to ionops website /setusers/ionops/Sites/* S2Kops.java ----------------------------------------------------------------------------------------------------------- Execute S2KrecentReader.java, validating prior S2Koutput Execute the program to create estimated F10 values in case a prediction is needed Execute HistFileUpdater.java to update SOLAR2000 inputs Run the main SOLAR 2000 model Clean out key directories so new files can be written (manageS2kopsFiles.java) calls S2KoutDelivery.java Write new spacewx.com index page (scp_to_isp will send) Update final run status manageS2kopsFiles.java ------------------------------------------------------------------------------------------------ cleans old Ap/Kp files from s2k_average*.pro located in SOLAR2000 operations_folder/dataio/ cleans old files located in /spacewx/s2kops/sftp/nowcast_archive/ cleans old files /spacewx/dataio/solar2000/data_backup/nowcasts/ cleans old files in /spacewx/dataio/solar2000/data_backup/nowcasts/ if mfd_enabled set in LocalFilePaths.java: cleans files in /spacewx/s2kops/sftp/mfdusr/nowcast_archive/ cleans files in /spacewx/s2kops/sftp/mfdusr/forecast_archive/ if isForecastEnabled: cleans files in /spacewx/dataio/solar2000/data_backup/forecasts/ with _val in filename cleans files in /spacewx/dataio/solar2000/data_backup/forecasts/ with _tsi in filename cleans files in /spacewx/dataio/solar2000/data_backup/forecasts/ outputSWDSnowcast.java ------------------------------------------------------------------------------------------------ creates SWDSnowcast.txt file and writes it into /spacewx/s2kops/sftp/swds_archive/, /spacewx/s2kops/sftp/swds/, and /spacewx/s2kops/sftp/s2kpg_v2_data/, and cleans old files if SWDSisPersistant is set in LocalFilePaths (archive Deprecated) ArchiveProxyData.java maintains the /spacewx/dataIO/solar2000/ArchivedProxies.txt file -------------------------------- scp_to_isp.java ------------------------------------------------------------------------------------------------------- if isOpsEnabled (set in LocalFilePaths.java): copies /spacewx/s2kops/main/operations_folder/ jpgs and /spacewx/s2kops/main/ logs to /setusers/s2kops/Sites* copies /spacewx/s2kops/sftp/swds/swdsNowcast.txt to /setusers/s2kops/Sites* copies /spacewx/s2kops/main/operations_folder/OPScommon/s2k_hist_proxies_v2_32.txt to /setusers/setusr/Sites/s2kpg_io/s2kpg_v2_hist_proxies.txt copies /spacewx/s2kops/main/operations_folder/solar2000_op_forecast/s2k_for4mon.txt to /setusers/setusr/Sites/s2kpg_io/s2kpg_v2_4monForecast.txt copies /spacewx/s2kops/sftp/swds/swdsNowcast.txt to /setusers/setusr/Sites/s2kpg_io/swdsNowcast.txt copies /spacewx/s2kops/main/operations_folder/dataIO/mfd.txt to /setusers/spcusr/Sites/dataIO/mfd.txt copies /spacewx/dataIO/solar2000/SolRes.dat.txt to /setusers/spcusr/JB2006/SolRes.dat.txt copies /spacewx/dataIO/mg2/Mg2_adj_predictor_plt.jpg, MgII_BestGuess.dat.txt, mg2_est.dat.txt, Mg2_adj_predictor_plt.jpg, to /setusers/s2kops/Sites/nowcast/Mg2_adj_predictor_plt.jpg if isIspEnabled or isWebEnabled: sends assorted /spacewx/s2kops/sftp/ nowcast and webdata files to spacewx.com Mg2_DB_main ----------------------------------------------------------------------------------------------------------- get and store Solstice data (/spacewx/dataIO/mg2/sorce_solstice_mg2_index.txt) get and store GOME data (/spacewx/dataIO/mg2/nesdis_gome/GOME_M02_MGII_YYYYMMDD) get and store most recent daily NESDIS NOAA-17 data (/spacewx/dataIO/mg2/nesdis_n17/PRD.OZONE.1B.N17.DYYdoy.Shhmm.Ehhmm.Bxxxxx) execute Update_refl_coeffs.java execute nesdis_mg2ops_noaa17.pro (/spacewx/s2kops/mg2dbase/mg2ops_data_dock/*.unf) execute N17_mg2_daily.pro (/spacewx/s2kops/mg2dbase/mg2ops_data_dock/N17_Mg2_daily_vals.txt) execute N17_mg2_daily_plot.pro (/spacewx/s2kops/mg2dbase/mg2ops_data_dock/cur_nesdis_N17_mg2.jpg) get and store SWPC MgII files /spacewx/dataIO/mg2/NOAAMgII_Last_30_Days.dat.txt), NOAA-16 (Deprecated) /spacewx/dataIO/mg2/NOAAMgIIUnix.dat), NOAA-17 execute Adj_mg2_bestOf4("20000101","/spacewx/dataIO/mg2/","mg2_2000_to_current.txt") execute Report_Sat_mg2.java (creates /spacewx/dataIO/mg2/NOAAMgII_Adjusted.dat.txt); execute Mg2_adj_predictor.pro (creates /spacewx/dataio/mg2/mg2_est.dat.txt,/spacewx/dataio/mg2/Mg2_adj_predictor_plt.jpg) execute Plot_Mg2_allSats.pro (creates /spacewx/dataio/mg2/Mg2_allSats_plt.jpg) execute Concantenate_NOAA_Mg2files.java /spacewx/dataIO/mg2/NOAAMgII.1978-99dat.txt + mg2_2000_to_current.txt -> NOAA_MgII_78_current.txt) /spacewx/dataIO/mg2/mg2_est.dat.txt -> /spacewx/dataIO/mg2/NOAA_MgII_78_current.txt) execute CopyTextFile(/spacewx/dataIO/mg2/NOAA_MgII_78_current.txt to: execute Plot_NOAAMgII_dat.pro, which plots the NOAAMgII.dat data in several time frames execute FileDeliver (copies /spacewx/dataio/mg2/Plot_NOAAMgII_dat_plt.jpg to: execute FileDeliver (copies /spacewx/s2kops/mg2dbase/mg2ops_data_dock/cur_nesdis_N17_mg2.jpg to: execute manage_Mg2_files(cleans: /spacewx/dataIO/mg2/nesdis_gome/,/spacewx/dataIO/mg2/nesdis_n17/, /spacewx/s2kops/mg2dbase/mg2ops_data_dock/) S2Kops.java ----------------------------------------------------------------------------------------------------------- reads most recent /spacewx/s2kops/sftp/nowcast/s2k_YYYY_MM_DD_HH_MM_out.txt file to validate maintains /spacewx/dataIO/penticton/pentictonHTML.dat and testPentictonHTML.dat files copies http://terra1.spacenvionment.net/~xrayops/dataIO/current_1minute.txt and current_flareIndices.txt to /spacewx/dataIO/xrays/ updates /spacewx/s2kops/main/operations_folder/OPScommon/s2k_hist_proxies_v2_32.txt with F10 and /spacewx/dataIO/mg2/mg2_est.dat.txt validates /spacewx/s2kops/main/launchS2Kops.log calls cleanS2Kproducts.java calls S2KoutDelivery.java calls writeSpaceWxIndex.java cleanS2Kproducts.java ------------------------------------------------------------------------------------------------- cleans /spacewx/s2kops/sftp/nowcast/ cleans /spacewx/s2kops/main/operations_folder/dataIO/ cleans /spacewx/s2kops/sftp/mfdusr/nowcast/ cleans /spacewx/s2kops/sftp/mfdusr/forecast/ S2KoutDelivery.java --------------------------------------------------------------------------------------------------- copies /spacewx/s2kops/main/readme_master.txt to /spacewx/s2kops/sftp/nowcast/readme.txt copies /spacewx/s2kops/main/operations_folder/s2k_validation_1_24hr.jpg to /spacewx/s2kops/sftp/nowcast/s2k_*_valid_1.jpg copies /spacewx/s2kops/main/operations_folder/s2k_1_24hr.jpg to /spacewx/s2kops/sftp/nowcast/s2k_*_FvsEc_1.jpg copies /spacewx/s2kops/main/operations_folder/s2k_2_24hr.jpg to /spacewx/s2kops/sftp/nowcast/s2k_*_spect_2.jpg copies /spacewx/s2kops/main/operations_folder/s2k_3_24hr.jpg to /spacewx/s2kops/sftp/nowcast/s2k_*_solar_3.jpg copies /spacewx/s2kops/main/operations_folder/s2k_validate.txt to /spacewx/s2kops/sftp/nowcast/s2k_*_val.txt copies /spacewx/s2kops/main/operations_folder/s2k_spectrum.txt to /spacewx/s2kops/sftp/nowcast/s2k_*_tsi.txt copies /spacewx/s2kops/main/operations_folder/s2k_nowcast.txt to /spacewx/s2kops/sftp/nowcast/s2k_*_out.txt copies /spacewx/s2kops/main/operations_folder/s2k_trend1.jpg to /spacewx/s2kops/sftp/nowcast/s2k_*_trend1.jpg copies /spacewx/s2kops/main/operations_folder/s2k_validation_1_24hr.jpg to /spacewx/s2kops/sftp/nowcast/e107_nowcast.jpg copies /spacewx/s2kops/main/operations_folder/s2k_validation_1_72hr.jpg to /spacewx/s2kops/sftp/forecast/e107_forecast.jpg copies /spacewx/s2kops/main/operations_folder/s2k_trend1.jpg to /spacewx/s2kops/sftp/nowcast/e107_trend_plot.jpg copies /spacewx/dataIO/solar2000/logs/S2KoutDelivery_deadman.log to /spacewx/s2kops/sftp/nowcast/s2k_*_runStatus.txt copies /spacewx/s2kops/main/operations_folder/s2k_validation_1_24hr.jpg to /spacewx/s2kops/sftp/nowcast_archive/s2k_YYYY_MM_DD_HH_MM_valid_1.jpg copies /spacewx/s2kops/main/operations_folder/s2k_validate.txt to /spacewx/s2kops/sftp/nowcast_archive/s2k_YYYY_MM_DD_HH_MM_val.txt copies /spacewx/s2kops/main/operations_folder/s2k_spectrum.txt to /spacewx/s2kops/sftp/nowcast_archive/s2k_YYYY_MM_DD_HH_MM_tsi.txt copies /spacewx/s2kops/main/operations_folder/s2k_nowcast.txt to /spacewx/s2kops/sftp/nowcast_archive/s2k_YYYY_MM_DD_HH_MM_out.txt copies /spacewx/s2kops/main/operations_folder/s2k_trend1.jpg to /spacewx/s2kops/sftp/nowcast_archive/s2k_YYYY_MM_DD_HH_MM_trend1.jpg copies /spacewx/s2kops/main/operations_folder/s2k_validation_1_24hr.jpg to /spacewx/dataIO/solar2000/data_backup/nowcasts/s2k_YYYY_MM_DD_HH_MM_valid_1.jpg copies /spacewx/s2kops/main/operations_folder/s2k_validate.txt to /spacewx/dataIO/solar2000/data_backup/nowcasts/s2k_YYYY_MM_DD_HH_MM_val.txt copies /spacewx/s2kops/main/operations_folder/s2k_spectrum.txt to /spacewx/dataIO/solar2000/data_backup/nowcasts/s2k_YYYY_MM_DD_HH_MM_tsi.txt copies /spacewx/s2kops/main/operations_folder/s2k_nowcast.txt to /spacewx/dataIO/solar2000/data_backup/nowcasts/s2k_YYYY_MM_DD_HH_MM_out.txt copies /spacewx/s2kops/main/operations_folder/s2k_trend1.jpg to /spacewx/dataIO/solar2000/data_backup/nowcasts/s2k_YYYY_MM_DD_HH_MM_trend1.jpg copies /spacewx/s2kops/main/operations_folder/OPScommon/s2k_hist_proxies_v2_32.txt to /spacewx/s2kops/sftp/s2kpg_v2_data/s2kpg_v2_hist_proxies.txt copies /Users/JB2006/Sites/SD_delivery_folder/SolRes.dat to /Users/JB2006/Sites/SD_delivery_folder/SolRes.dat.txt copies /Users/JB2006/Sites/SD_delivery_folder/JB_delivery81_v3_9.txt to /Users/JB2006/Sites/indices/JB_delivery81_v3_9.txt copies /spacewx/s2kops/main/operations_folder/s2k_validation_1_72hr.jpg to /spacewx/dataIO/solar2000/data_backup/forecasts/s2k_YYYY_MM_DD_HH_MM_valid_1_72hr.jpg copies /spacewx/s2kops/main/operations_folder/s2k_tsi_72hr.txt to /spacewx/dataIO/solar2000/data_backup/forecasts/s2k_YYYY_MM_DD_HH_MM_tsi_72hr.txt copies /spacewx/s2kops/main/operations_folder/s2k_output_72hr.txt to /spacewx/dataIO/solar2000/data_backup/forecasts/s2k_YYYY_MM_DD_HH_MM_out_72hr.txt copies /spacewx/s2kops/main/operations_folder/s2k_validation_file_72hr.txt to /spacewx/dataIO/solar2000/data_backup/forecasts/s2k_YYYY_MM_DD_HH_MM_val_72hr.txt copies /spacewx/s2kops/main/operations_folder/s2k_trend28.jpg to /spacewx/dataIO/solar2000/data_backup/forecasts/s2k_YYYY_MM_DD_HH_MM_trend28.jpg copies /spacewx/dataIO/SEM_folder/Daily_v3.txt to /Users/semdata/Sites/data/Daily_v3.txt copies /spacewx/s2kops/main/operations_folder/s2k_output_39.txt to /soldat/projects/caps_ops/s2k_flare_code/s2k_output_39.txt copies /spacewx/s2kops/main/operations_folder/s2k_output_39.txt to /soldat/projects/caps_ops/s2k_flare_code/s2k_output_39.txt copies /spacewx/s2kops/main/readme_mfdusr_master.txt to /spacewx/s2kops/sftp/mfdusr/forecast/readme_mfdusr.txt copies /spacewx/s2kops/main/operations_folder/dataIO/mfd.txt to /spacewx/s2kops/sftp/mfdusr/forecast_archive/mfd_YYYY_MM_DD_HH_MM.txt copies /spacewx/dataIO/solar2000/logs/S2KoutDelivery_deadman.log to /spacewx/s2kops/sftp/mfdusr/nowcast/s2k_YYYY_MM_DD_HH_MM_runStatus.txt copies /spacewx/dataIO/solar2000/logs/S2KoutDelivery_deadman.log to /spacewx/s2kops/sftp/mfdusr/forecast/s2k_YYYY_MM_DD_HH_MM_runStatus.txt copies /spacewx/s2kops/main/operations_folder/s2k_validation_1_72hr.jpg to /spacewx/s2kops/sftp/mfdusr/forecast_archive/s2k_YYYY_MM_DD_HH_MM_valid_1_72hr.jpg copies /spacewx/s2kops/main/operations_folder/s2k_tsi_72hr.txt to /spacewx/s2kops/sftp/mfdusr/forecast_archive/s2k_YYYY_MM_DD_HH_MM_tsi_72hr.txt copies /spacewx/s2kops/main/operations_folder/s2k_output_72hr.txt to /spacewx/s2kops/sftp/mfdusr/forecast_archive/s2k_YYYY_MM_DD_HH_MM_out_72hr.txt copies /spacewx/s2kops/main/operations_folder/s2k_validation_file_72hr.txt to /spacewx/s2kops/sftp/mfdusr/forecast_archive/s2k_YYYY_MM_DD_HH_MM_val_72hr.txt copies /spacewx/s2kops/main/operations_folder/s2k_trend28.jpg to /spacewx/s2kops/sftp/mfdusr/forecast_archive/s2k_YYYY_MM_DD_HH_MM_trend28.jpg copies /spacewx/s2kops/main/operations_folder/s2k_validation_1_24hr.jpg to /spacewx/s2kops/sftp/mfdusr/nowcast_archive/s2k_YYYY_MM_DD_HH_MM_valid_1.jpg copies /spacewx/s2kops/main/operations_folder/s2k_validate.txt to /spacewx/s2kops/sftp/mfdusr/nowcast_archive/s2k_YYYY_MM_DD_HH_MM_val.txt copies /spacewx/s2kops/main/operations_folder/s2k_spectrum.txt to /spacewx/s2kops/sftp/mfdusr/nowcast_archive/s2k_YYYY_MM_DD_HH_MM_tsi.txt copies /spacewx/s2kops/main/operations_folder/s2k_nowcast.txt to /spacewx/s2kops/sftp/mfdusr/nowcast_archive/s2k_YYYY_MM_DD_HH_MM_out.txt copies /spacewx/s2kops/main/operations_folder/s2k_trend1.jpg to /spacewx/s2kops/sftp/mfdusr/nowcast_archive/s2k_YYYY_MM_DD_HH_MM_trend1.jpg copies /spacewx/s2kops/main/operations_folder/s2k_validation_1_24hr.jpg to /spacewx/s2kops/sftp/mfdusr/nowcast/s2k_YYYY_MM_DD_HH_MM_valid_1.jpg copies /spacewx/s2kops/main/operations_folder/s2k_1_24hr.jpg to /spacewx/s2kops/sftp/mfdusr/nowcast/s2k_YYYY_MM_DD_HH_MM_FvsEc_1.jpg copies /spacewx/s2kops/main/operations_folder/s2k_2_24hr.jpg to /spacewx/s2kops/sftp/mfdusr/nowcast/s2k_YYYY_MM_DD_HH_MM_spect_2.jpg copies /spacewx/s2kops/main/operations_folder/s2k_3_24hr.jpg to /spacewx/s2kops/sftp/mfdusr/nowcast/s2k_YYYY_MM_DD_HH_MM_solar_3.jpg copies /spacewx/s2kops/main/operations_folder/s2k_validate.txt to /spacewx/s2kops/sftp/mfdusr/nowcast/s2k_YYYY_MM_DD_HH_MM_val.txt copies /spacewx/s2kops/main/operations_folder/s2k_spectrum.txt to /spacewx/s2kops/sftp/mfdusr/nowcast/s2k_YYYY_MM_DD_HH_MM_tsi.txt copies /spacewx/s2kops/main/operations_folder/s2k_nowcast.txt to /spacewx/s2kops/sftp/mfdusr/nowcast/s2k_YYYY_MM_DD_HH_MM_out.txt copies /spacewx/s2kops/main/operations_folder/s2k_trend1.jpg to /spacewx/s2kops/sftp/mfdusr/nowcast/s2k_YYYY_MM_DD_HH_MM_trend1.jpg copies /spacewx/s2kops/main/operations_folder/s2k_validation_1_72hr.jpg to /spacewx/s2kops/sftp/mfdusr/forecast/s2k_YYYY_MM_DD_HH_MM_valid_1_72hr.jpg copies /spacewx/s2kops/main/operations_folder/s2k_1_72hr.jpg to /spacewx/s2kops/sftp/mfdusr/forecast/s2k_YYYY_MM_DD_HH_MM_FvsEc_1_72hr.jpg copies /spacewx/s2kops/main/operations_folder/s2k_2_72hr.jpg to /spacewx/s2kops/sftp/mfdusr/forecast/s2k_YYYY_MM_DD_HH_MM_spect_2_72hr.jpg copies /spacewx/s2kops/main/operations_folder/s2k_3_72hr.jpg to /spacewx/s2kops/sftp/mfdusr/forecast/s2k_YYYY_MM_DD_HH_MM_solar_3_72hr.jpg copies /spacewx/s2kops/main/operations_folder/s2k_tsi_72hr.txt to /spacewx/s2kops/sftp/mfdusr/forecast/s2k_YYYY_MM_DD_HH_MM_tsi_72hr.txt copies /spacewx/s2kops/main/operations_folder/s2k_output_72hr.txt to /spacewx/s2kops/sftp/mfdusr/forecast/s2k_YYYY_MM_DD_HH_MM_out_72hr.txt copies /spacewx/s2kops/main/operations_folder/s2k_validation_file_72hr.txt to /spacewx/s2kops/sftp/mfdusr/forecast/s2k_YYYY_MM_DD_HH_MM_val_72hr.txt copies /spacewx/s2kops/main/operations_folder/s2k_trend28.jpg to /spacewx/s2kops/sftp/mfdusr/forecast/s2k_YYYY_MM_DD_HH_MM_trend28.jpg copies /spacewx/s2kops/main/operations_folder/dataIO/mfd.txt to /spacewx/s2kops/sftp/mfdusr/forecast/mfd_YYYY_MM_DD_HH_MM.txt writeSpaceWxIndex.java ----------------------------------------------------------------------------------------------- reads /spacewx/s2kops/webData/latestNews.txt reads /spacewx/s2kops/main/operations_folder/s2k_nowcast.txt reads /spacewx/dataIO/solar2000/logs/s2k_ToeTagger.log reads /spacewx/s2kops/webData/index_master.html reads images/green_dot.jpg, yellow_dot.jpg, or red_dot.jpg creates /spacewx/s2kops/webData/index.html