readDWD.binaryandreadDWD.rklim: use tz for timestampsreadDWD.radar: dividebyten default fixedplotRadar: mar properly used againdataDWD: gains argument 'retryhist'- several examples updated to reflect DWD changes
locdirnow defaults to R_user_dirdataDWD: gains argument removeftp- website migrated from bookdown.org to github pages
- new functions:
readDWD.hyras,readDWD.asczip,checkUpdates dataDWD: fileIndex warning now also visible for long vectorsselectDWD: handles files removed from FTP but still in indexreadDWD.multia: new argument tryenc to try different encodingsreadDWD.data: convert timestamp to as.DatereadDWD.meta: reflect DWD changes (Abgabe column, standard_format beschreibung file)readDWD.nc: flip the map uprightindexFTP: more options and checks, reflect removal of tree.htmlnearbyStations: new arguments mindex and currentcheckIndex: checks + messages improved, false positives excluded- documentation + website improved in several spots
- rhub tests updated
readDWD.grib2: pack option rgdal removed.- all instances of
raster/rgdal/spcode replaced withterracode - cross references and website improved
dataDWD: dir default set tolocdir()- interactive weather comparison app added
findID+selectDWD: new argument failempty to stop instead of warn if name does not matchreadDWD.grib2: rgdal retirement warning addeddataDWD+readDWD: new argument hr to auto-merge historical and recent filescreateIndex: speed and correctness improvedrunLocalTests: tests expanded, internally restructuredreadDWD: new argument quietread- this NEWS file is completely reformatted and changed into NEWS.md
plotDWDlocdir(will replace fixed "DWDdata" folder indataDWD)readDWD.derivreadDWD.rklimreadDWD.pdfvalidFileTypes(charstring vector)
selectDWD: is completely rewritten and now vectorizes expandingly- reading functions: use latin1 encoding
dataDWD: new argument method, new default for overwrite- several improvements for input checks, messages, tests and documentation
metaInfo: accepts custom indexreadDWD.radar: new argument dividebytenreadDWD.grib2: new argument pack- website: new use case daily radar files
readVars: new argument quiet (for updateIndexes)readDWD.grib2: initial releaseprojectRasterDWD: new argument adjust05dataDWD: new default: dbin=TRUE
readDWD.data: fread checks for system commandunzip, prints final value in messagedataDWD: unfound URL messages also link to website fileIndex in German localeupdateRdwd: version and date comparison improved, print local version if newer than on githubcreateIndex: improved recognition of "Beschreibung_Stationen" meta filesdwdparams+updateIndexes: missing/duplicate 'Kurz' entry messages improvedreadDWD: subfunction names in elegant message outside the loop to avoid interrupted progbars.indexFTP+dirDWD: trailing slashes removed with regexpfileType: more informative message for failed type determinationDEU: now derived from NUTS regions and with new CRS (along withEUR)runLocalTests: improved logfiles, false positive messages removed
- package structure moved to first chapter
- fread instructions expanded
- FTP Folder list expanded
- more messages / warnings suppressed that are irrelevant to readers
- linked to in seeAlso sections of suitable function documentations
- redirected man pages are now correctly linked to (e.g. fileIndex -> index)
- documentation and dataset links are now opened in a new window
- new use case: values at locations in grid
- FTP address updated everywhere
dataDWD: argument file renamed to url to avoid confusion with local file namesreadDWD: fread default set to NA. This is an experiment, see issue #22readDWD: now has argument type (determined by new functionfileType) to replace the ever growing list of typesdataDWD,readDWD,selectDWD: order of arguments changed to reflect importanceplotRadar: gains arguments axes, las, zlim, col, mar, keeppar. main now defaults to (and correctly keeps) x@title.selectDWD: gains argument remove_dupli to ignore DWD file upload errorsreadDWD.*: All subfunctions message their identity and have a quiet argument- new function:
rdwdquiet() readDWD.meta: station and bundesland names are now char instead of factor (since R 4.0.0)indexFTP: new argument fast to read file tree with data.tablecreateIndex: gains argument checklogrunLocalTests: new arguments fordevtools::checkandcheckIndexreadVars: params now an explicit argument (defaults todwdparams)
EUR: extends further east for plots with large width compared to heightupdateRdwd: unloads package before installation and informs about the need to re-loadcheckIndex: new check for duplicate meta files, writes to logfile (append, no overwrite), nicer path print, logs modification time of index fileslldist: fix error that occurred when a df with a single row was givenrunLocalTests: warning logfile cleared before writing,checkIndexresults included, false positives removed, on github- source code function argument sections all have line breaks (except
readDWD.*) - documentation source code now is written in markdown, source files have been reorganized
- cross-references in documentation improved
metaInfo: from/to columns date conversion correctedindexFTP+dataDWD: up to date and centralized sleep informationdataDWD: Download failure message improved, refer to fileIndex section on homepage if applicable.readDWD.nc: ncdf warning suppressedselectDWD: combines all warnings within the loop to a single message
- improved (and stand-alone) fileIndex section
plotRadarused for nice maps- huxtable fixed
- use global quiet option instead of explicit
quiet=TRUEall the time - history section added
- package schematic revamped completely
projectRasterDWD: latlon=T/F replaced with targetprojreadDWD.binary: output list element renamed to 'dat' (from 'data') for consistency with other functionsdataDWD: new argument dbin- new functions:
updateRdwd,plotRadar
readDWD.data: now correctly reads 10 minute timestampsreadDWD.meta: column widths identified more elegantly and safelyindexFTP: warn about requests to https instead of ftp servers, new argumentexclude.latest.binaddBorders: added sp to 'Suggests', movedDEU+EURto inst/extdata to handle CRAN build+check on systems without sp installed
- list of FTP Folders now with clickable URLs
- RQ example added
- order of radar graphs changed for better comparison in pdf
- Vignettes moved to bookdown.org/brry/rdwd with nice structure
- improved reading of gridded data, documented in vignette chapter "Raster data"
readRadarFileexpanded + moved to own package (dwdradar) with proper tests and better warnings- Hexsticker created
readDWD.binary: untarring improvedprojectRasterDWD: default extents + projs added for seasonal + nc- source code directory structure updated
- quiet argument added to many functions
readDWD: order and documentation of method selection improvedmetaIndex+fileIndex: date columns are now of class DatedataDWD: force can now be number of hours after which to re-download- various minor fixes, see https://github.com/brry/rdwd/commits
readDWD.radar+readDWD.nc+readDWD.standcheckSuggestedPackagesEUR+addBordersformatIndexrunLocalTestsupdateIndexes(not exported)
- Binary Radolan data can now be read correctly
- The new FTP server is used
- Raster data can easily be projected
- All
readDWDsubfunctions now have their own documentation
dataDWD: arguments toreadDWDremoved (can be passed with ...)dataDWD: gains joinbf argument to join base and relative url pathreadDWD: can expand DWD abbreviations in column names (varnames=TRUE)readDWD: source code structure is improved.readDWD.multia: ignores EndOfFile characters in multiannual data on UnixreadDWD.raster: acceptsgunziparguments, reads faster on second callsreadDWD.data: informatively handles empty filesreadDWD.binary+raster+asc: overlay Germany maps in example plotsreadDWD.binary: unzips into a given exdir (and reads faster on second calls)readDWD.binary: transforms output to a raster stackselectDWD: suggests only available data in interactive optionselectDWDandnearbyStations: fail informatively for typical errorsfileIndex: loses the unnnecessary leading slashesindexFTP: uses tree of files at new FTP server
newColumnNamesdwdparams(renamed fromparameter_abreviations)gridbasegridIndexprojectRasterDWDlocaltestdir(though mainly for internal usage)
readDWD.ascreadRadarfile+bin2num+ FORTRAN codecheckIndex
First major version increase!
- Tests are now systematic and comprehensive (albeit run locally and manually to reduce CRAN load and enable local file writing).
selectDWDgot a very noticable performance boost and an interactive res/var/per selection.- Handling raster files is now supported in rdwd.
- Examples and vignettes have been refined.
- Detailed changes can be found on https://github.com/brry/rdwd/commits
dataDWD: dots now passed toreadDWD, download errors checked and returned as informative warningreadDWD: reading functions added for binary, raster and multi_annual files, MESS_DATUM POSIXct column added in monthly data, list output now namedindexFTP: now removes duplicates from file list, sped up in default 1min/prec usage- rdwd now works fine with multi_annual and subdaily data
readVars: parameter abbreviations completed, output now visibleselectDWD: order of arguments changed, interactive res/var/per selection enabled, computing speed extremely increasedlocaltests.Rheavily expanded, examples reduced and refined- indexes + vignettes updated, use cases expanded with
nearbyStationsexample - New functions and objects:
readMeta,dwdbase(central package base url)
dataDWD: argument force can now be NA to download files older than 24 hours- hourly/solar timestamp now processed automatically
- use cases vignette added
- vignettes precompiled + CRAN tests removed to reduce automated load on DWD Server
indexFTP: got much smarter in discerning files from folders- indexes expanded for new DWD data
- New function:
readVars, along withparameter_abreviations
- created new index with sub-hourly data, reflected in data overview at
selectDWD dataDWD,readDWD,selectDWD: file ending checks more elegantcreateIndex: updated to handle the new files- some minor improvements, see https://github.com/brry/rdwd/commits
readDWD: readDWD.data and readDWD.meta are now separate (non-exported) functionsreadDWD: fread default is now FALSEdataDWD: fread and overwrite arguments added- references dutch meteo package and useR!2017 rdwd presentation
- importFrom entries completed
- DESCRIPTION: BugReports entry added
- reflects DWD FTP update June 1
indexFTP: ftp blockage chance reduced, data loss avoided, progress bar added- errors/warnings/messages now often include a traceback
metaInfo: tells about non-public filescreateIndex+readDWD: read meta files in German locale to handle Umlaute- Index documentation and creation unified
- Vignettes and readme improved
- various minor improvements and fixes, see https://github.com/brry/rdwd/commits
renamed: indexDWD -> indexFTP
added: lldist, maxlldist, nearbyStations
no longer exported in NAMESPACE: rowDisplay, dirDWD
removed: fileDWD, geoIndexAll
- interactive map now colored by availability of recent file
- stations with slightly varying coordinates (<900 m apart) aggregated in
geoIndex - documentation corrections, improved messages in
fileDWDanddirDWD - map vignette expanded, package vignette abbreviated slightly
metaInfo: printout greatly improved- duplicate index entries removed
- New function:
rowDisplay - New object:
geoIndexAll - Removed object:
mapDWD(to reduce package size)
Initial release of the package, development can be seen at https://github.com/brry/rdwd/compare/master@{2016-10-19}...master@{2017-01-24}
selectDWD: uses index information to find files matching a path or station criteria.- With the returned path/file names,
dataDWDandreadDWDdownload and read data. dirDWDandfileDWD: control that no file will be overwritten and path messages are useful.indexDWD: lists all the files on the FTP server with DWD data.createIndex: uses that list to createfileIndex,metaIndexandgeoIndex.mapDWD: is an interactive leaflet map also useful to explore datasets.
Note: dataDWD and readDWD were started in June 2016 within my misc package berryFunctions, from which they will be deleted after rdwd is on CRAN