NovaStar Data Web Services / Release Notes / Version 1
- Version 1.14.0
- Version 1.13.1
- Version 1.13.0
- Version 1.12.1
- Version 1.12.0
- Version 1.11.5
- Version 1.11.4
- Version 1.11.3
- Version 1.11.2
- Version 1.11.1
- Version 1.11.0
- Version 1.10.1
- Version 1.10.0
- Version 1.9.2
- Version 1.9.1
- Version 1.9.0
- Version 1.8.0
- Version 1.7.2
- Version 1.7.1
- Version 1.7.0
- Version 1.6.1
- Version 1.6.0
- Version 1.5.5
- Version 1.5.4
- Version 1.5.3
- Version 1.5.2
- Versions 1.5.0 - 1.5.1
- Release notes for all versions
Version 1.14.0
Feature release to improve services for source line numbers and plots and enable the
tslist service
[#399] Add the GroupModeconfiguration property to control when user group filter is required for services, used with NovaStarCloud and multi-tenant systems.
Update the checkDatabaseservice:- [#394] Update the
outputResourceGroups=trueformat to fix formatting issues for some checks. AddrelatedDataelements to output to better describe some checks. - [#401] Change the default output format to be similar to
outputResourceGroups=trueusing a top-level list ofresources.
- [#394] Update the
[#377] Update the dataSourcesservice:- Search the scheduler items for known programs that implement the
-Scommand parameter.
- Search the scheduler items for known programs that implement the
Update the dataTypesservice:- Enable the
Precip(SHEFPP, precipitation increment) data type by default for Operator output, which enables the time series in thestationSummariesservice.
- Enable the
[#377] Update the tscatalogservice:- The
pointTypeIdvalue is now included in output to facilitate relating to point types. - The
valueDigitsvalue has been added to facilitate review of handling display digits. - Add the
tsidoutput element to replacetimeSeriesIdentifierelement. Thetsidname is consistent with other services. Both values will be included for some time to allow transition totsid.
- The
Update the tsproductservice:- [#378] Enable multiple
tsidand handle for alarm time series as a point graph. - [#377] Populate the
yaxesproperties with basic information.
- [#378] Enable multiple
[#377] Add the stationDataSourcesservice:- This service provides a list of source line numbers used with a station.
[#396] Add the tslistservice:- Enable the service with initial CSV, JSON and GeoJSON output formats.
Version 1.13.1
Maintenance release to fix issues with new features in the previous release.
[#373] Fix the dataReportsservice:- Was not allowing single character flag filters due to adding support for multi-character source lines.
[#374] Add the pointFlagsandpointStatusesservices.
Version 1.13.0
** Feature release to provide data for source line numbers.**
[#366] Add the dataSourcesservice:- List data source line number and other data from the configuration table and data imports.
- Update the
data,dataReports, andtsservices so thatsourceLineNumberfilters the data reportflagsformat using:- merged line numbers (current design)
- proposed new format
VE,1,3,3, where line numbers are separated by commas
Update the checkDatabaseservice:- [#361] Add
Userresource type and check for empty full name. - [#368] Add the
outputResourceGroupsquery parameter to output a format used by the Administrator application's troubleshooting page.
- [#361] Add
Update the tsservice:- Time series for data source line can now be queried, with 1Hour count currently supported.
Version 1.12.1
Maintenance release to improve the
checkDatabase service.
Update the checkDatabaseservice:- [#361] Add checks for
users, including a check for empty user full name,
- [#361] Add checks for
Update the dataTypesservice:- [#365] Change ALERT2 Type5 message data types and
Apduidto useAlert2in front of the data type. This groups the data types when sorted and makes them easier to distinguish from other data. - [#367] Add built-in data type
DataReportto use with source line number data report counts.
- [#365] Change ALERT2 Type5 message data types and
Update the dataservice:- [#367] Add
sourceLineNumberfilter on data report flags.
- [#367] Add
Update the dataReportsservice:- [#367] Add
sourceLineNumberfilter on data report flags.
- [#367] Add
Update the tsservice:- [#367] Add
sourceLineNumberfilter on data report flags.
- [#367] Add
Version 1.12.0
Feature release including enhancements to the plots and
checkDatabase services.
- Update the user documentation:
- Services are now grouped into major categories to facilitate use.
A service may be listed in more than one group.
The groups are consistent with the
api-uipage. - The documentation for each service groups parameters info "Filter", "Output", etc., to improve usability of the documentation.
- Improve the troubleshooting documentation to include more examples of errors.
- Add a discussion of results components.
- Services are now grouped into major categories to facilitate use.
A service may be listed in more than one group.
The groups are consistent with the
Update the dataTypesservice:- [#327] Fix the SHEF physical element
HJso that the data type isHeightSpillwayGate(had a typo) - [#341] Add standard built-in non-SHEF data types so that they do not need to be configured as custom data types. Additional built-in types will be added over time to encourage consistency.
- [#327] Fix the SHEF physical element
Update the tsservice:- [#349] Fix so that
Countstatistic time series have units ofCount.
- [#349] Fix so that
[#358] Enhance data caching integration with the Administrator:- Saving data from the Administrator causes data caches to be invalidated in web services.
- When retrieving data, the data are internally handled so that caches are refreshed in the appropriate order to ensure that materialized data are correctly updated.
[#349] Handle HTTP headers to improve the responseInfoso that the original URL is shown and should be a valid user-facing URL:- Use
X-Original-URLif provided. - Or, use
X-Forwarded-Hostif provided. - Or, use
X-Forwarded-Forif provided.
- Use
[#331] Remove installing chromium, since it is not needed for web services to function
and chromium may not be used on systems without a desktop GUI installed.
It is still installed in the development environment.
[#314,#317] Update the alarmTriggersservice:- Add
pointIdandpointNumIdparameters to filter alarm triggers for a point. - Add
alarmGroupIdandalarmGroupNameparameters to filter alarm triggers for a group. - Add
description,message,name,novaScore, andtypeparameters to filter alarm triggers.
- Add
- Update the
api-uiservice:
[#319] Add a link to https://software.trilynx.systems
for the full API documentation and improve the formatting of the page introduction.
Update the checkDatabaseservice:- [#312] Add a check for null station numerical identifier, which should not happen but was found in one system.
- [#336] Check that scheduler items do not have empty description.
- [#338] Check that rating assign SHEF parameter code is valid as a data type.
- [#345] Check that if a point has rating assigns defined,
the
ratedvalue should be true, indicating that computations should occur. - [#347] Problems for a resource are now output with the specific resource (previously were only output at station and point level). Summary problems are added in higher-level objects and detailed problems are added with the specific object.
- [#347] Problems at the highest level now list the number of problems for a resource but do not include object information.
- [#347] Add the
checkAlarms,checkPoints, etc. query parameters to control which data resources are checked. - [#347] Add the
alarmId,pointNumId, etc. query parameters to specify specific objects to check. - [#347] Add the
forceOutputquery parameter to cause details to be output even if no problems. - [#348] Change the default to not process retired points and stations.
Add the
includeRetiredPointsandincludeRetiredStationsparameter to enable checking retired data. - [#351] Add a check for
VoltageBatterypoints for no report alarm. Also add a check that all stations have at least one point with a no report alarm. These are best practices and are indicated as suggestions. - [#353] Change
resourcetoresourceType, clarify the resource count properties, addproblemTypeto the problem object. - [#354] Add a check for
PrecipAccumpoints that don't have rated values for incremental precipitation and storm total. - [#355] Check ALERT2 protocol stations for points that have
sensorId=nullif a sensorID=0is also used for any point. - [#360] Add the
problemTypequery parameter to filter the types of checks that are output.
[#333] Update the dataservice:- Add the
countparameter to limit the number of records in output. - Add the
sortparameter to sort output.
- Add the
[#333] Update the dataReportsservice:- Add the
countparameter to limit the number of records in output. - Add the
sortparameter to sort output.
- Add the
[#315] Update the equationsservice:- Add filter parameters.
[#358] Update the invalidateCacheservice:- Dependencies are checked so that invaliding a resource also invalidates related resources, such as relation data.
[#335] Update the pointsservice:- Add the
stationTypeNameandstationTypeProtocolquery parameters to filter stations.
- Add the
[#335] Update the stationsservice:- Add the
stationTypeNameandstationTypeProtocolquery parameters to filter stations.
- Add the
[#335] Update the tscatalogservice:- Add the
stationTypeNameandstationTypeProtocolquery parameters to filter stations. - Do not add a problem to the
problemslist if it has already been added.
- Add the
[#316] Add the equationImportsservice for equation imports. Equation imports provide input input for equations.
[#339] Add the tsproductservice to provide time series product configurations.
Version 1.11.5
Maintenance release to improve the plots service.
- Update the
plotsservice:
[#305] Fix the bug where default plots were causing an error when
calculating point.override.*Countoutput properties.
[#307] Fix the bug where a retired point resulted in an error
when requesting the time using the point tag name (necessary to uniquely identify the time series).
Update the tsservice:- [#306] Output station description properties using
station.Property=Valueand point description properties usingpoint.Property=value.
- [#306] Output station description properties using
Version 1.11.4
Maintenance release to enable the ts readData query parameter.
Update many services that use a boolean query parameter.
The check for valid values was not being performed so invalid values always used false.
Update the tsservice:- Add the
readDataparameter, which allows reading time series metadata without reading the data. This feature simplifies listing available time series.
- Add the
Version 1.11.3
Maintenance release to improve the plots handling of data analysis.
Update the plotsservice:- [#297] Add the
ui.point.options.analysis.displayIntervalquery parameter to provide granular control of the display interval from the Administrator. - [#298] Add the
tsServiceParametersquery parameter for use withformat=tspjsonto faciliate creating thetsservice request for the time series, needed to duplicate NovaStaranalysis(statparm) analysis for plots. The query parameters handle analysis flags, etc.
- [#297] Add the
Update the tsservice:- [#296] Change the
addquery parameter toanalysisFlagAddbe consistent with the NovaStar analysis flagaddparameter. - [#296] Change the
multiplyquery parameter toanalysisFlagMultbe consistent with the NovaStar analysis flagmultparameter.
- [#296] Change the
Version 1.11.2
Maintenance release to enhance the reports service, other maintenance.
Fix the alarmsservice:- [#276] The service was not properly handling point and station filters,
resulting in null values for
pointNumId,stationId, andstationNumId. This has been fixed and thedataTypefilter also now works. - [#283] Fix so that the
alarmState=Ackquery parameter value is allowed. - [#289] Fix so that querying a long period for a point works. Previously did not detect when a point was specified, resulting in a warning.
- [#276] The service was not properly handling point and station filters,
resulting in null values for
Fix the plotsservice:- [#285] Fix so that text annotations are included in
format=tspjsonoutput.
- [#285] Fix so that text annotations are included in
Fix the tscatalogservice:- [#281] Fix so that the
stationOutOfServicequery parameter works.
- [#281] Fix so that the
Fix the dataReportsservice:- [#280] The
format=csvoutput column order was not conducive to visual review and use. The order now puts the most important columns on the left. Consuming applications should determine the column order from the headers.
- [#280] The
Update the
nsdatawsscript to call the installer. This program is available for system administration.
Update the alarmsservice:- [#284] Add the
includeRelatedObjects=truequery parameter to output related point and station objects in JSON output.
- [#284] Add the
Update the plotsservice:- [#287] Change the
ui.point.options.analysisquery parameter toui.point.analysisto be consistent with the database. - [#287] Change the default statistic from
NeartoLastto be consistent with command line programs and the Administrator default UI choice. - [#287] The
ui*query parameters are now output asuiPropertiesfor the time series product to facilitate troubleshooting. Several additional properties are output to help troubleshoot analysis strings, includingpoint.analysis.dbcparm.isAnalysisValid.
- [#287] Change the
Update the reportsservice:- [#286] Implement initial
format=tspjsonoutput.
- [#286] Implement initial
Update the tscatalogservice:- [#282] Add the
pointDescription,pointName, andpointOutOfServicequery parameters
- [#282] Add the
Version 1.11.1
Maintenance release to enhance the plots service.
Update the dataservice:- [#271] Enhance the
flagquery parameter to acceptor,and, andnotsyntax, to facilitate data review. - [#274] Change so that by default, data records with
Vthat do not haveMare returned.
- [#271] Enhance the
Update the dataReportsservice:- [#271] Enhance the
flagquery parameter to acceptor,and, andnotsyntax, to facilitate data review. - [#274] Change so that by default, data records with
Vthat do not haveMare returned.
- [#271] Enhance the
[#257] Update the plotsservice:- Add a
POSTHTTP method to allow the Administrator to override database plot properties and create plots without being saved in the database. Full functionality is not yet implemented. - Add
pointIdandpointNumIdquery parameter for default point plot configuration. - Add
stationIdquery parameter for default station plot configuration and allowstationNumIdto be used for this purpose. - Add
tspRequestTypequery parameter to allow more control over how to create time series products. Full functionality is not yet implemented.
- Add a
Update the stationStatisticsservice:- [#271] Enhance the
flagquery parameter to acceptor,and, andnotsyntax, to facilitate data review. - [#274] Change so that by default, data records with
Vthat do not haveMare returned.
- [#271] Enhance the
Update the tsservice:- [#271] Enhance the
flagquery parameter to acceptor,and, andnotsyntax, to facilitate data review. - [#274] Change so that by default, data records with
Vthat do not haveMare returned.
- [#271] Enhance the
Version 1.11.0
Feature release to add the maps service.
[#258] Add the initial mapsservice for map data.
[#263] Add the initial checkDatabaseservice to check the database.
Version 1.10.1
Maintenance release to enhance the plots and ts services.
Update the documentation to use underline for links
to comply with web accessibility best practices.
Change station data dashboardUrlto use Operator station dashboard without hash.
[#220] Update the plotsservice:- Related to
format=tspjson:- Add the
novastarPropertieselement toformat=tspjsonoutput to keep separate from standardproperties. - Add the
problemselement toformat=tspjsonnovastarPropertiesoutput to help troubleshoot unsupported plot properties and data issues (such as missing SHEF parameter code) that will impact plot configurations. - Add support for raw, scaled, and rated time series in the
analysisstring, although not all computations (statistics) are yet implemented intsservice). Theanalysisstring is handled better by using legacy Administrator code. - Add query parameters
test.annotation.number,test.annotation.options.limit,test.annotation.options.limitScale,test.annotation.options.orientationto provide test data that overrides a saved annotation. - Add query parameter
ui.endingTimeto provide the ending time used to expand the_ENDINGTIMEin plot panel title and annotation text. - Add query parameters
ui.point.options.analysisandui.plot.options.plotOrientationto allow the properties to be specified by the Adminstrator to override the saved plot configuration. - Don't limit time series in plots to the
tscatalogtime series list (tscatalogdoes not include all permutations of time series data type, statistic, and interval, and therefore is a smaller subset of possible time series). - Handle multiple right y-axes based on plot point options
scaleand time series productaxeslist. Left and right y-axis precision and direction are now handled. Plot points (time series) and annotations are associated with a y-axis and some options likerangeLimitsfor points are set at the y-axis level. - Handle y-axis limits specified as fixed or point data.
- Handle horizontal and vertical annotations.
- The time series product
MainTitleStringis set to the plotname. If the name isnull, an empty string is output.
- Add the
- Related to
Update the tsservice:- Add the
addandmultiplyservice parameters to support the Administrator software. - Add new statistics:
Count,Last,Near.
- Add the
Add the statisticTypesservice to list statistic types.
Version 1.10.0
Feature release including Swagger/OpenAPI documentation and Debian Bullseye support.
[#219] Fix bug where newline in descriptions caused a line break when format=csvis requested. ThenewlineReplacementservice parameter can now be specified and defaults to a space for the following services:
Fix bug in the ratingTablesservice:- the
descriptionwas not being included in output
- the
[#218] Fix bug in the tsservice where the time seriesdescriptionproperty was not set for interval time series calculated from the scaled value time series.
The nsdatawsprogram has been updated:- [#191] Add a
helpcommand to the interactive menu. - [#224] Update the installer to remove old versions.
Also add a menu command and
--tomcat-versioncommand parameter to set the Tomcat major version, which allows old versions to be managed during updates. For example usesudo nsdataws stop --tomcat-version=8. - Fix a bug where editing log files mixed up the file order when selecting.
- [#191] Add a
Statistics output now includes sampleSize, which is the number of values used to compute the statistic (does not count null,NaN, or missing values).
Update the dataservice:- [#231] Add
format=datadispto mimic the NovaStar command linedatadispprogram. - [#231] Add
format=datadisp_qto mimic the NovaStardatadisp_qcgi-binprogram used to format data for legacy web applications. - [#235] Add
flag=*to return all records without having to provide a list of flags.
- [#231] Add
[#235] Update the dataReportsservice:- Add
flag=*to return all records without having to provide a list of flags.
- Add
Update the plotsservice:- [#220] The
format=tspjsonparameter has been added, which will output an array of time series product configurations, suitable for display by charting applications. - [#236] The
format=e19jsonandstationNumIdparameters have been added, which will output of station E19 plot configurations, suitable for display by charting applications. The initial implementation will be enhanced in later software releases.
- [#220] The
[#228] Update the pointsservice:- By default, don't return points that have
Status=RetiredorTest=True. - Add the
includeRetiredPoints=trueparameter to enable output of retired points. - Add the
includeTestPoints=trueparameter to enable output of test points.
- By default, don't return points that have
[#228] Update the stationSummariesservice:- Add the
includeRetiredPoints=trueparameter to enable output of retired points (default is don't output). - Add the
includeTestPoints=trueparameter to enable output of test points (default is don't output).
- Add the
[#235] Update the tsservice:- Add
flag=*to return all records without having to provide a list of flags.
- Add
Update the tscatalogservice:- Add the
includeProblemTsquery parameter to allow filtering the catalog based on whether a time series has configuration problems. This is useful for troubleshooting data issues.
- Add the
Add the ratingAssignComputationTypesservice to list computation type number and name.
Add the stationE19sservice to provide station E19 data for flood levels.
[#61] Enable the Swagger/OpenAPI interactive query builder tool:- Use the
api-uiservice to access the interactive URL builder. - The
api-uiservice provides the editor for services and is referenced in service documentation. - Due to this change, web services are now case-specific, whereas previously they were case-independent.
Refer to the
api-uiservice and documentation to confirm URL syntax. Some applications may need to be updated.
- Use the
Version 1.9.2
Maintenance release to fix bug in parsing descriptions with embedded properties.
[#215] Fix bug where station, point and other descriptions that accept
embedded Property=Valuestrings were not handling properties with spaces around the equals sign. Embedded properties must not have spaces around the equals sign and equals with space on either side is now handled as a normal description.
Version 1.9.1
Maintenance release to fix bug in custom data types.
[1.9.1] Fix bug where the custom data types file was only handling one custom type.
Version 1.9.0
Feature release to improve handling of time series and statistic value digits in output.
[1.9.0] Add the pointPropertiesservice to provide point properties from the point description.
[1.9.0] Add the stationPropertiesservice to provide station properties from the station description.
[1.9.0] Update the pointsservice:- The
pointTypeIdparameter has been added to match points for a point type.
- The
[1.9.0] Update the ratingAssignsservice:- The
pointNumIdparameter has been added to match rating assigns for a point numerical identifier.
- The
[1.9.0] Update the stationStatisticsservice:- The number of digits for statistic values is now consistent with the number of digits used to format time series values.
- The
valueDigitsparameter has been added to override the default number of digits used for output. - The
statisticValueNameparameter now accepts tilde-delimited values to avoid the need to URL-encode properties identified with${ }syntax.
[1.9.0] Update the stationSummariesservice:- The number of digits for time series data and statistic values is now consistent with the digits specified in the point type for scaled value time series.
- The number of digits for time series data and statistic values is now consistent with the digits specified in the rating table output for rated value time series.
- The
valueDigitsparameter has been added to override the default number of digits used for output.
[1.9.0] Update the tsservice:- The number of digits for data values is now consistent with the digits specified in the point type for scaled value time series.
- The number of digits for data values is now consistent with the digits specified in the rating table output for rated value time series.
- The
valueDigitsparameter has been added to override the default number of digits used for output.
Version 1.8.0
Feature release to improve the performance of services that read data reports, and includes a number of maintenance updates.
[1.8.0] Fix bugs in the tscatalogservice:- Fixed bug where the service generated a parameter check error if the
dataTypeincluded a statistic, such as used with interval time series. This limited the ability to filter the catalog. - Fixed bugs where requesting a catalog list for interval time series using specific
dataTypeanddataIntervalvalues returned nothing. The service now always queriesIrregSecondinterval first and then applies interval statistic to output when the original query returns results. Interval time series stored in the database, such as with SHEFEduration may not be listed - this will be addressed in the future.
- Fixed bug where the service generated a parameter check error if the
[1.8.0] Add the dataReportsservice to read data reports using the databasedata_selectfunction and return results in flattened form, which is particularly useful when querying a short data period.
[1.8.0] Release the initial version of the
nsdataws-clicommand line interface to data web services, useful for automating time series downloads.
[1.8.0] Improve the documentation for
tools to facilitate using web services.
[1.8.0] The stations data cache used to improve performance
now includes retired stations by default.
Services that use stations typically omit retired stations for real-time data
and include retired stations if historical data queries.
See the includeRetiredStationsparameter for services.
[1.8.0] Update the following services to internally use the
new dataReportsservice to improve performance when querying short data periods, and add thedataServicequery parameter to allow control of how data reports are queried:
[1.8.0] Improve performance profile output controlled
with the includeProfilequery parameter for the following services:
[1.8.0] Update the
dataservice as follows:- Add
flagparameter to allow filtering based on data flag.
- Add
[1.8.0] Update the
pointTypesservice as follows:- Add
pointNumIdparameter to match point types for a point. - Add
stationNumIdparameter to match point types for a station.
- Add
[1.8.0] Update the
stationSummariesservice as follows:- Precipitation total statistic for
14Dayand21Dayintervals have been removed since the values are seldom used and add processing time.
- Precipitation total statistic for
[1.8.0] Update the
tsservice as follows:- Add
flagparameter to allow filtering based on data flag.
- Add
Version 1.7.2
Maintenance release to fix specific issues discovered in using web services.
[1.7.2] Fixed bugs in the tsservice:- Requesting a
locIdwith a point tag name part caused an error when searching points that have null point tag name in the database. - Specifying a
locIdwith point tag name part when not needed did not match time series - both forms oflocIdare now supported.
- Requesting a
[1.7.2] Fixed a bug in the following services where groupIdandgroupNamefilters were ignored:
[1.7.2] Update the
stationStatisticsservice:- Enhanced
statisticValueNameto allow!{Property}notation in addition to${Property}, to facilitate use with software that also uses the latter notation and might be in conflict during processing. - Change the default value of
statisticValueNameto${dataType}-${statistic}.${interval}, which works better withgeojsonformat given that each unique name corresponds to an attribute table property (if necessary, consuming applications can request the old format in the query string). - Enable the
includeProfilefunctionality for JSON default format, to help evaluate performance. - Fix the typo in the station property
dashboadUrlto bedashboardUrl.
- Enhanced
Version 1.7.1
Maintenance release to fix issues in the previous version and implement changes to support automated testing.
[1.7.1] Move documentation appropriate for system administrators
into separate "for Administrators" documentation.
This documentation now focuses on web services users.
[1.7.1] Update the echoservice to return a response format similar to other services.
[1.7.1] Change the stationsservice:- Add the
dataTypeandlocIdquery parameters to allow easier query of data corresponding to time series data types. - Add
stationandpointdata to the response to facilitate understanding checking and using the data records.
- Add the
[1.7.1] Change the stationsservice:- Change the
operatorStationDashboardUrloutput property todashboardUrlto facilitate use. - Add
includeRetiredStationsandincludeTestStationsquery parameters to control handling of stations (default is to not return retired or test stations).
- Change the
[1.7.1] Change the stationsservice:- Add
includeRetiredStationsandincludeTestStationsquery parameters to control handling of stations (default is to not return retired or test stations). - Sort statistics and data types alphabetically by default to facilitate automated testing.
- Add
[1.7.1] Change the stationsservice:- Add
includeRetiredStationsandincludeTestStationsquery parameters to control handling of stations (default is to not return retired or test stations). - Fix bug where station type identifier was not being set.
- Fix bug where rated value time series were not being handled correctly for statistic calculations.
- Add
Version 1.7.0
Feature release to address issues with rating assigns that change data table slots over time, and implements additional changes to support web services administration.
[1.7.0] Fix the pointservice to include station identifier data - previously was always null.
[1.7.0] Fix the tsandstationSummariesservices to handle rating assigns that change the data table array position of rated values.
[1.7.0] Fix the tsservice to set data flags from the rated values.
[1.7.0] The pointsservice has been updated as follows:- Points allow additional properties in the description.
- Now includes
descriptionTextproperty.
[1.7.0] The stationSummariesservice has been updated as follows:- Rating assign and rating tables data are now cached to improve performance.
- Only read rating assign data for the query period to improve processing performance.
- Add
includeTestStationsquery parameter to handle test stations.
[1.7.0] The tscatalogservice has been updated as follows:- Allows
*wildcard in thedataTypequery parameter. This is useful for specifyingPrecip*to see which rated value time series are defined for a station. - Add
pointIdquery parameter.
- Allows
[1.7.0] Add experimental values queryTargetMsandqueryTargetMetto thereponseInfoincluded in JSON, to begin phasing in performance analytics.
Version 1.6.1
Maintenance release to enhance tscatalog service for data troubleshooting.
[1.6.1] The tscatalogservice has been updated to be more precise in handling cases where point tag name warnings are generated in cases where time series identifiers are not unique.
[1.6.1] The tscatalogservice now haslocIdquery parameter, useful to match identifiers wherePOINTTAGis in thelocIddue to a non-unique identifier.
[1.6.1] The following services have been updated to provide groupIdparameter to optionally limit results to the specified group identifier(s). Additional support has also been added to filter results based on station, point, and data type.
Version 1.6.0
Feature release focusing on the new stationStatistics service.
[1.6.0] The following services have been updated to provide groupNameparameter to optionally limit results to the specified group name(s):
[1.6.0] The dataTypesservice has been updated:sortparameter allows sorting the results. Results can now also be filtered bydisplayNameandshefPhysicalElement.- Filters now ignore case.
- The
nsdataws-datatypes.jsonfile has been implemented for custom data types. Thensdataws-datatypes.csvfile will be phased out and is not used if the JSON file is found. - The
isValidoutput now checks whether first 2 characters are uppercase (invalid because conflicts with SHEF parameter code). The newisValidErrorvalue is output ifisValid=false.
[1.6.0] The stationsservice now returns GeoJSON, which includes station type protocol to allow filtering.
[1.6.0] The stationSummariesservice statistics are now calculated using a sample window > the start time and <= the end time. Previously the window was >= the start time and <= the end time. This may have impacted a small number of calculations.
[1.6.0] The stationStatisticsservice has been added to return multiple statistics for stations, for exampleLastfor last value in an interval.
Version 1.5.5
This patch release focuses on fixes to support MeanArealPrecip data type processing,
and other minor feature fixes.
[1.5.5] Fix a bug where the stationSummariesdid not handle data types with inadvertent space in data type name. White space is now removed.
[1.5.5] The stationSummariesandtsservices have been updated to includenoReportIntervalin output, which is used to indicate how the last report will persist prior to another reading
[1.5.5] The previous stationSummariesincluded a work-aroundincludeAllDataTypesquery parameter to control whether multiple time series of the same data type are returned (because not unique). The work-around parameter has been removed. Multiple time series of the same data type can be returned, and the associated point ID, point tag, etc. can be used to differentiate between time series. Consuming software must be able to handle and not assume that data type alone is unique at a station.
[1.5.5] The stationSummariesservice now automatically uses statistics data typeMeanArealPrecipas follows:Total.
[1.5.5] Add built-in SHEF parameter physical element codes MI,ML,MU, andMV.
[1.5.5] The stationSummariesandtscatalogservices now havegroupNameparameter to limit results to stations associated with a group.
[1.5.5] The groupsservice has been added to return NovaStar group data.
Version 1.5.4
This patch release focuses on fixes to have better control of interval time series calculations.
[1.5.4] Fix a bug where the stationSummariesservice request could fail if any point or any station query had an error. The service will now always return data for stations and points that have no errors.
[1.5.4] Fix a bug where the stationSummariesservice could have an error for a rating assign that is defined but has no data.
[1.5.4] Fix a bug where the stationSummariesdid not include point properties with time series.
[1.5.4] Change the tsservice so that interval time series by default only return intervals that include data reports. Query parametersincludeReports,includeEstimates, andincludeMissinghave been added to control how many values are returned. Experience has shown that returning estimates and missing can greatly increase the size of the response and in some cases cause out of memory errors. Implement logic to use last value in no report interval if value for an interval with no other data report. The defaults may change as additional access control features are added. Also enable theTimeWeightedMeanstatistic.
[1.5.4] Improve handling of query period.
Services now share common features. See the perioddocumentation.
Version 1.5.3
This patch release focuses on fully-enabling custom data types in addition to built-in SHEF data types that use SHEF parameter code physical element.
[1.5.3] Fix a number of issues that were impacting the tsandtscatalogservice, including retrieval of interval data stored in NovaStar. The services were not consistent with recent addition of custom data types. Issues have been fixed.
[1.5.3] Fix issue related to SHEF to data type conversion due to uppercase comparison issue.
This resulted in some time series not being found.
[1.5.3] Fix bug in some queries where a requested period of record using full
period indicator (*) was being interpreted as the default period (last month).
[1.5.3] Fix bug where tscomma-separated output headings were abbreviated. Data values are now also output to the number of digits configured for the data type in NovaStar.
[1.5.3] Fix bug introduced in 1.5.2 where tscatalogrequest could get into a race condition because internal cache oftscatalogresults was regenerated multiple times. A cached catalog is used to check for uniqueness of the output list records.
[1.5.3] The stationSummariesincludeAllDataTypesparameter now has a default value oftrue. This parameter will be removed in the future because it was implemented to help as a transition in design.
Version 1.5.2
This patch release focuses on returning multiple same data types at a station.
[1.5.2] Fix the pointTypesidquery, useful for troubleshooting.
[1.5.2] The stationSummariesservice now returns all data types and time series - previously multiple same data types would only return the first match. The service now also returns correct rated data type rather than defaulting toDischargeRiver. TheincludeAllDataTypesparameter has been added as a work-around to evaluate returning multiple same data types in the summary, with default value offalse.
[1.5.2] The statistic data has been updated to include the associated point identifier
to allow unique association with time series and triggers,
necessary because stationSummaries?forOperatorStationDashboard=truenow returns multiple same data types if found for a station.
[1.5.2] The dataTypesservice now provides query parameters. TheDepthOfReadingdata type (equivalent toHBSHEF physical element) is now configured by default to be returned forstationSummariesservice for Operator.
[1.5.2] The ratingAssignsservice now allows queries byidandpointId.
[1.5.2] Improve the tscatalogservice checks to determine whether a time series is a forecast. Also improve setting thelocIdto unique value. If necessary, the pointtag nameis used in thelocIdto ensure a unique time series identifier. A cached version oftscatalogresults are used to look up whether duplicate time series would otherwise result.
Versions 1.5.0 - 1.5.1
[1.5.1] Installer was not properly setting file ownership and permission for a new install,
causing web services to not find configuration and other files. This has been fixed.
[1.5.0] Data resource caching was not working properly and has been fixed.
The default expiration on cached data is now set to 1 hour.
[1.5.0] All services now include attributionAndUsageelement whenformat=json, which allows organizations to indicate disclaimer, license, attribution, and usage guidelines.
[1.5.0] The data,ts, andstationSummariesservices now providetimezonequery parameter to indicate the output time zone. This is useful when the NovaStar database stores data from multiple time zones or the server uses a different time zone from the local time zone.
[1.5.0] The
stationsservice has been updated to includedescriptionText, which is the same asdescriptionbut without additional station properties.
[1.5.0] Add nsdatawsprogram to manage web services.
[1.5.0] Web services are now implemented as full Linux service - use the nsdatawsprogram to manage.
[1.5.0] Online user documentation for data web services is available.
[1.5.0] Add alarmStatesservice.
[1.5.0] Add alarmTriggerTypesservice.
[1.5.0] Add dataTypesservice to list built-in data types from SHEF parameter codes and custom data types. Also addnsdataws-datatypes.csvconfiguration file for custom data types, for cases when SHEF parameter codes are not available.
[1.5.0] Add ratingRowsservice for rating rows (used for ratings).
[1.5.0] Add ratingShiftsservice for rating shifts (used for ratings).
[1.5.0] Add ratingTablesservice for rating tables (used for ratings).
[1.5.0] Add stationTypesservice for station types.