inversionExt
Inversion Externe
Process to calculate inversion of stations from measured flow avalaible on WFS for external user. Allow to update or re-create inversion already stored.
PyWPS Process Inversion Externe finished
url
URL of WFS service where download measured flow
http://geowww.agrocampus-ouest.fr/geoserver/ore/agrhys_donnees_hydro_jour/wfs
typename
TypeName of workspace:layer
agrhys_donnees_hydro_jour
fields
List of fields names of this layer for station,date,data,geom (respect the order and "," separator, no space).
name,jour,q,geom2154
project
Project name of this inversion to store them
agrhys
processing
Delete/create inversion (0) or update inversion (1) ?
0
service
Service WFS
WFS
version
Version of WFS
1.0.0
token
User token for identification send by email
tloree29
user_id
User identification send by email
master
coefficient_conversion
Conversion coefficient to get the flow rate in m3/s
0.001
stations
Set specific stations to create his basin. Use "," to divide station name (ex : J458795,J545879)
None
wfsIndex
Does the WFS uses index ? (yes) or (no)
no
cache
If you want to store the sources stations flow in your database (yes) or (no)
no
log
Log informations about process
log
Log informations about process
=0&PropertyName=(name,jour,q)&outputFormat=CSV
2021-01-07 19:34:23,133 :: INFO :: Get period of data downloaded
2021-01-07 19:34:23,158 :: INFO :: verification si besoin conversion
2021-01-07 19:34:23,160 :: INFO :: conversion to m3/s
2021-01-07 19:34:23,174 :: INFO :: ['FID', 'name', 'jour', 'q']
2021-01-07 19:34:23,174 :: INFO :: Last date downloaded has 2019-10-02
2021-01-07 19:34:23,175 :: INFO :: Calculation of hydraulic length with xy2hl
2021-01-07 19:34:23,176 :: INFO :: /usr/local/mntsurf/bin/xy2hyl -d -v -s -b 100 -x 169045.883 -y 6784223.821 -m /data/sig/mnt/ign/bretagne50/bretexu50.mnt -o /tmp/pywps_process_1bg3733l/E31_bzh_hyl.tif -p epsg:2154 -q epsg:2154 -f GTiff -w
2021-01-07 19:34:24,719 :: INFO :: xy2hl finish
2021-01-07 19:34:24,720 :: INFO :: pre-process data for inversion
2021-01-07 19:34:24,741 :: INFO :: Index(['date', 'debit'], dtype='object')
2021-01-07 19:34:24,753 :: INFO :: ['/usr/local/R/R-4.0.3/bin/Rscript', '/usr/local/simfen-test/scripts/r/inversion.R', '--idg', 'E31', '--wd', '/tmp/pywps_process_1bg3733l/', '--flow', '/tmp/pywps_process_1bg3733l/preprocess_debit_E31.csv', '--speed', 'brittany2013', '--hydraulic_length', '/tmp/pywps_process_1bg3733l/E31_bzh_hyl.tif', '--psw', 'tloree29', '--user', 'tloree', '--host', 'localhost', '--dbname', 'simfen_test', '--project', 'agrhys']
2021-01-07 19:34:27,283 :: INFO :: Stockage in DB of new inversion for station E31
2021-01-07 19:34:27,321 :: INFO :: Inversion for station E31 done
2021-01-07 19:34:27,321 :: INFO :: calcul des periodes manquantes
2021-01-07 19:34:27,329 :: INFO :: nombre de gap : 6
2021-01-07 19:34:27,331 :: INFO :: update stations index : date_start and date_end
2021-01-07 19:34:27,348 :: INFO :: Start E3 inversion, process : 33.333333333333336 pour cent calculated
2021-01-07 19:34:27,356 :: INFO :: Get inversion period of station E3 (if exist)
2021-01-07 19:34:27,358 :: INFO :: Set wfs request to download all data available for the station E3
2021-01-07 19:34:27,358 :: INFO :: Download data http://geowww.agrocampus-ouest.fr/geoserver/ore/agrhys_donnees_hydro_jour/wfs?service=WFS&version=1.0.0&request=getFeature&typeName=agrhys_donnees_hydro_jour&cql_filter=name='E3' AND q>=0&PropertyName=(name,jour,q)&outputFormat=CSV
2021-01-07 19:34:27,585 :: INFO :: Get period of data downloaded
2021-01-07 19:34:27,615 :: INFO :: verification si besoin conversion
2021-01-07 19:34:27,617 :: INFO :: conversion to m3/s
2021-01-07 19:34:27,633 :: INFO :: ['FID', 'name', 'jour', 'q']
2021-01-07 19:34:27,634 :: INFO :: Last date downloaded has 2019-08-22
2021-01-07 19:34:27,634 :: INFO :: Calculation of hydraulic length with xy2hl
2021-01-07 19:34:27,635 :: INFO :: /usr/local/mntsurf/bin/xy2hyl -d -v -s -b 100 -x 168966.468 -y 6784204.109 -m /data/sig/mnt/ign/bretagne50/bretexu50.mnt -o /tmp/pywps_process_1bg3733l/E3_bzh_hyl.tif -p epsg:2154 -q epsg:2154 -f GTiff -w
2021-01-07 19:34:29,261 :: INFO :: xy2hl finish
2021-01-07 19:34:29,262 :: INFO :: pre-process data for inversion
2021-01-07 19:34:29,287 :: INFO :: Index(['date', 'debit'], dtype='object')
2021-01-07 19:34:29,318 :: INFO :: ['/usr/local/R/R-4.0.3/bin/Rscript', '/usr/local/simfen-test/scripts/r/inversion.R', '--idg', 'E3', '--wd', '/tmp/pywps_process_1bg3733l/', '--flow', '/tmp/pywps_process_1bg3733l/preprocess_debit_E3.csv', '--speed', 'brittany2013', '--hydraulic_length', '/tmp/pywps_process_1bg3733l/E3_bzh_hyl.tif', '--psw', 'tloree29', '--user', 'tloree', '--host', 'localhost', '--dbname', 'simfen_test', '--project', 'agrhys']
2021-01-07 19:34:38,247 :: INFO :: Stockage in DB of new inversion for station E3
2021-01-07 19:34:38,285 :: INFO :: Inversion for station E3 done
2021-01-07 19:34:38,285 :: INFO :: calcul des periodes manquantes
2021-01-07 19:34:38,291 :: INFO :: nombre de gap : 2
2021-01-07 19:34:38,293 :: INFO :: update stations index : date_start and date_end
2021-01-07 19:34:38,309 :: INFO :: Start Exutoire inversion, process : 50.0 pour cent calculated
2021-01-07 19:34:38,320 :: INFO :: Get inversion period of station Exutoire (if exist)
2021-01-07 19:34:38,321 :: INFO :: Set wfs request to download all data available for the station Exutoire
2021-01-07 19:34:38,321 :: INFO :: Download data http://geowww.agrocampus-ouest.fr/geoserver/ore/agrhys_donnees_hydro_jour/wfs?service=WFS&version=1.0.0&request=getFeature&typeName=agrhys_donnees_hydro_jour&cql_filter=name='Exutoire' AND q>=0&PropertyName=(name,jour,q)&outputFormat=CSV
2021-01-07 19:34:38,589 :: INFO :: Get period of data downloaded
2021-01-07 19:34:38,622 :: INFO :: verification si besoin conversion
2021-01-07 19:34:38,624 :: INFO :: conversion to m3/s
2021-01-07 19:34:38,649 :: INFO :: ['FID', 'name', 'jour', 'q']
2021-01-07 19:34:38,650 :: INFO :: Last date downloaded has 2019-08-29
2021-01-07 19:34:38,650 :: INFO :: Calculation of hydraulic length with xy2hl
2021-01-07 19:34:38,651 :: INFO :: /usr/local/mntsurf/bin/xy2hyl -d -v -s -b 100 -x 265547.204 -y 6783314.02 -m /data/sig/mnt/ign/bretagne50/bretexu50.mnt -o /tmp/pywps_process_1bg3733l/Exutoire_bzh_hyl.tif -p epsg:2154 -q epsg:2154 -f GTiff -w
2021-01-07 19:34:40,175 :: INFO :: xy2hl finish
2021-01-07 19:34:40,176 :: INFO :: pre-process data for inversion
2021-01-07 19:34:40,206 :: INFO :: Index(['date', 'debit'], dtype='object')
2021-01-07 19:34:40,250 :: INFO :: ['/usr/local/R/R-4.0.3/bin/Rscript', '/usr/local/simfen-test/scripts/r/inversion.R', '--idg', 'Exutoire', '--wd', '/tmp/pywps_process_1bg3733l/', '--flow', '/tmp/pywps_process_1bg3733l/preprocess_debit_Exutoire.csv', '--speed', 'brittany2013', '--hydraulic_length', '/tmp/pywps_process_1bg3733l/Exutoire_bzh_hyl.tif', '--psw', 'tloree29', '--user', 'tloree', '--host', 'localhost', '--dbname', 'simfen_test', '--project', 'agrhys']
2021-01-07 19:34:54,322 :: INFO :: Stockage in DB of new inversion for station Exutoire
2021-01-07 19:34:54,418 :: INFO :: Inversion for station Exutoire done
2021-01-07 19:34:54,418 :: INFO :: calcul des periodes manquantes
2021-01-07 19:34:54,440 :: INFO :: nombre de gap : 26
2021-01-07 19:34:54,443 :: INFO :: update stations index : date_start and date_end
2021-01-07 19:34:54,463 :: INFO :: Start E10 inversion, process : 66.66666666666667 pour cent calculated
2021-01-07 19:34:54,477 :: INFO :: Get inversion period of station E10 (if exist)
2021-01-07 19:34:54,480 :: INFO :: Set wfs request to download all data available for the station E10
2021-01-07 19:34:54,480 :: INFO :: Download data http://geowww.agrocampus-ouest.fr/geoserver/ore/agrhys_donnees_hydro_jour/wfs?service=WFS&version=1.0.0&request=getFeature&typeName=agrhys_donnees_hydro_jour&cql_filter=name='E10' AND q>=0&PropertyName=(name,jour,q)&outputFormat=CSV
2021-01-07 19:34:54,666 :: INFO :: Get period of data downloaded
2021-01-07 19:34:54,686 :: INFO :: verification si besoin conversion
2021-01-07 19:34:54,688 :: INFO :: conversion to m3/s
2021-01-07 19:34:54,694 :: INFO :: ['FID', 'name', 'jour', 'q']
2021-01-07 19:34:54,694 :: INFO :: Last date downloaded has 2019-10-02
2021-01-07 19:34:54,695 :: INFO :: Calculation of hydraulic length with xy2hl
2021-01-07 19:34:54,696 :: INFO :: /usr/local/mntsurf/bin/xy2hyl -d -v -s -b 100 -x 169123.022 -y 6784553.579 -m /data/sig/mnt/ign/bretagne50/bretexu50.mnt -o /tmp/pywps_process_1bg3733l/E10_bzh_hyl.tif -p epsg:2154 -q epsg:2154 -f GTiff -w
2021-01-07 19:34:56,222 :: INFO :: xy2hl finish
2021-01-07 19:34:56,223 :: INFO :: pre-process data for inversion
2021-01-07 19:34:56,238 :: INFO :: Index(['date', 'debit'], dtype='object')
2021-01-07 19:34:56,246 :: INFO :: ['/usr/local/R/R-4.0.3/bin/Rscript', '/usr/local/simfen-test/scripts/r/inversion.R', '--idg', 'E10', '--wd', '/tmp/pywps_process_1bg3733l/', '--flow', '/tmp/pywps_process_1bg3733l/preprocess_debit_E10.csv', '--speed', 'brittany2013', '--hydraulic_length', '/tmp/pywps_process_1bg3733l/E10_bzh_hyl.tif', '--psw', 'tloree29', '--user', 'tloree', '--host', 'localhost', '--dbname', 'simfen_test', '--project', 'agrhys']
2021-01-07 19:34:57,944 :: INFO :: Stockage in DB of new inversion for station E10
2021-01-07 19:34:57,972 :: INFO :: Inversion for station E10 done
2021-01-07 19:34:57,972 :: INFO :: calcul des periodes manquantes
2021-01-07 19:34:57,977 :: INFO :: nombre de gap : 2
2021-01-07 19:34:57,978 :: INFO :: update stations index : date_start and date_end
2021-01-07 19:34:57,995 :: INFO :: Start E30 inversion, process : 83.33333333333333 pour cent calculated
2021-01-07 19:34:58,010 :: INFO :: Get inversion period of station E30 (if exist)
2021-01-07 19:34:58,012 :: INFO :: Set wfs request to download all data available for the station E30
2021-01-07 19:34:58,012 :: INFO :: Download data http://geowww.agrocampus-ouest.fr/geoserver/ore/agrhys_donnees_hydro_jour/wfs?service=WFS&version=1.0.0&request=getFeature&typeName=agrhys_donnees_hydro_jour&cql_filter=name='E30' AND q>=0&PropertyName=(name,jour,q)&outputFormat=CSV
2021-01-07 19:34:58,184 :: INFO :: Get period of data downloaded
2021-01-07 19:34:58,208 :: INFO :: verification si besoin conversion
2021-01-07 19:34:58,209 :: INFO :: conversion to m3/s
2021-01-07 19:34:58,217 :: INFO :: ['FID', 'name', 'jour', 'q']
2021-01-07 19:34:58,217 :: INFO :: Last date downloaded has 2019-10-23
2021-01-07 19:34:58,217 :: INFO :: Calculation of hydraulic length with xy2hl
2021-01-07 19:34:58,218 :: INFO :: /usr/local/mntsurf/bin/xy2hyl -d -v -s -b 100 -x 169092.85 -y 6784376.78 -m /data/sig/mnt/ign/bretagne50/bretexu50.mnt -o /tmp/pywps_process_1bg3733l/E30_bzh_hyl.tif -p epsg:2154 -q epsg:2154 -f GTiff -w
2021-01-07 19:34:59,735 :: INFO :: xy2hl finish
2021-01-07 19:34:59,736 :: INFO :: pre-process data for inversion
2021-01-07 19:34:59,754 :: INFO :: Index(['date', 'debit'], dtype='object')
2021-01-07 19:34:59,788 :: INFO :: ['/usr/local/R/R-4.0.3/bin/Rscript', '/usr/local/simfen-test/scripts/r/inversion.R', '--idg', 'E30', '--wd', '/tmp/pywps_process_1bg3733l/', '--flow', '/tmp/pywps_process_1bg3733l/preprocess_debit_E30.csv', '--speed', 'brittany2013', '--hydraulic_length', '/tmp/pywps_process_1bg3733l/E30_bzh_hyl.tif', '--psw', 'tloree29', '--user', 'tloree', '--host', 'localhost', '--dbname', 'simfen_test', '--project', 'agrhys']
2021-01-07 19:35:03,837 :: INFO :: Stockage in DB of new inversion for station E30
2021-01-07 19:35:03,920 :: INFO :: Inversion for station E30 done
2021-01-07 19:35:03,920 :: INFO :: calcul des periodes manquantes
2021-01-07 19:35:03,939 :: INFO :: nombre de gap : 1
2021-01-07 19:35:03,940 :: INFO :: update stations index : date_start and date_end
2021-01-07 19:35:03,957 :: INFO :: Start E4 inversion, process : 100.0 pour cent calculated
2021-01-07 19:35:03,971 :: INFO :: Get inversion period of station E4 (if exist)
2021-01-07 19:35:03,974 :: INFO :: Set wfs request to download all data available for the station E4
2021-01-07 19:35:03,974 :: INFO :: Download data http://geowww.agrocampus-ouest.fr/geoserver/ore/agrhys_donnees_hydro_jour/wfs?service=WFS&version=1.0.0&request=getFeature&typeName=agrhys_donnees_hydro_jour&cql_filter=name='E4' AND q>=0&PropertyName=(name,jour,q)&outputFormat=CSV
2021-01-07 19:35:04,210 :: INFO :: Get period of data downloaded
2021-01-07 19:35:04,239 :: INFO :: verification si besoin conversion
2021-01-07 19:35:04,241 :: INFO :: conversion to m3/s
2021-01-07 19:35:04,261 :: INFO :: ['FID', 'name', 'jour', 'q']
2021-01-07 19:35:04,261 :: INFO :: Last date downloaded has 2019-10-02
2021-01-07 19:35:04,261 :: INFO :: Calculation of hydraulic length with xy2hl
2021-01-07 19:35:04,262 :: INFO :: /usr/local/mntsurf/bin/xy2hyl -d -v -s -b 100 -x 168963.133 -y 6784214.911 -m /data/sig/mnt/ign/bretagne50/bretexu50.mnt -o /tmp/pywps_process_1bg3733l/E4_bzh_hyl.tif -p epsg:2154 -q epsg:2154 -f GTiff -w
2021-01-07 19:35:05,782 :: INFO :: xy2hl finish
2021-01-07 19:35:05,783 :: INFO :: pre-process data for inversion
2021-01-07 19:35:05,810 :: INFO :: Index(['date', 'debit'], dtype='object')
2021-01-07 19:35:05,841 :: INFO :: ['/usr/local/R/R-4.0.3/bin/Rscript', '/usr/local/simfen-test/scripts/r/inversion.R', '--idg', 'E4', '--wd', '/tmp/pywps_process_1bg3733l/', '--flow', '/tmp/pywps_process_1bg3733l/preprocess_debit_E4.csv', '--speed', 'brittany2013', '--hydraulic_length', '/tmp/pywps_process_1bg3733l/E4_bzh_hyl.tif', '--psw', 'tloree29', '--user', 'tloree', '--host', 'localhost', '--dbname', 'simfen_test', '--project', 'agrhys']
2021-01-07 19:35:14,703 :: INFO :: Stockage in DB of new inversion for station E4
2021-01-07 19:35:14,743 :: INFO :: Inversion for station E4 done
2021-01-07 19:35:14,743 :: INFO :: calcul des periodes manquantes
2021-01-07 19:35:14,751 :: INFO :: nombre de gap : 6
2021-01-07 19:35:14,752 :: INFO :: update stations index : date_start and date_end
2021-01-07 19:35:14,769 :: INFO :: update congiguration date
2021-01-07 19:35:14,776 :: INFO :: LIST OF STATIONS NOT UPDATED, SO CHECK THEM MANUALLY : []
2021-01-07 19:35:14,813 :: INFO :: Inversion done
2021-01-07 19:35:14,813 :: INFO :: creation reponse
2021-01-07 19:35:14,814 :: INFO :: envoie reponse
]]>