1. 09 Aug, 2019 3 commits
  2. 07 Aug, 2019 1 commit
    • Alessio Netti's avatar
      Analytics: added job filtering · 584093ba
      Alessio Netti authored
      - A regular expression (jobFilter) can be applied to the jobs' nodelists
      to identify the jobs that need to be treated by each collectagent in a
      cluster
      - By default only the first node in the nodelist is considered, but this
      behavior can be customized
      584093ba
  3. 31 Jul, 2019 1 commit
    • Alessio Netti's avatar
      Analytics: minor changes to QueryEngine · 02abd6cd
      Alessio Netti authored
      - querySensor does not return NULL pointers anymore, but always
      the "buffer" input argument
      - the previous implementation was more descriptive of error statuses,
      but much more prone to leaking memory in case of improper usage
      - Also fixed a warning in the MSR plugin
      02abd6cd
  4. 30 Jul, 2019 1 commit
  5. 29 Jul, 2019 1 commit
  6. 01 Jul, 2019 1 commit
  7. 17 Jun, 2019 1 commit
    • Alessio Netti's avatar
      Analytics: bugfixes for job analyzers · 2564afba
      Alessio Netti authored
      - Fixed a fair amount of bugs related to job analyzers
      - Added a "getJobsInIntervalRunning" method to JobDataStore, to get
      the list of jobs that were running in a certain time interval
      - Some code refactoring for the JobDataStore class to reduce duplication
      - Job analyzers have been tested and are working properly as of now
      2564afba
  8. 13 Jun, 2019 1 commit
  9. 12 Jun, 2019 1 commit
    • Alessio Netti's avatar
      Analytics: Aggregator plugin re-worked · 6d2b07a0
      Alessio Netti authored
      - Now supports also standard deviation and percentile computation
      - Multiple output sensors per analyzer can be defined, each performing
      a different aggregation task
      - QueryEngine has been slightly modified so as not to clear the input
      sensor reading buffer (if any), thus allowing to accumulate sensor
      values with subsequent calls
      6d2b07a0
  10. 04 Jun, 2019 1 commit
  11. 31 May, 2019 1 commit
  12. 28 May, 2019 2 commits
    • Alessio Netti's avatar
      Documentation and fixes · 69739f0a
      Alessio Netti authored
      - Added documentation to the new SensorID implementation
      - NOTE: virtual sensors will likely require some modifications due to
      how topics are handled now ('/' separator clashing with divide symbol)
      69739f0a
    • Alessio Netti's avatar
      Fully-operational string MQTT topics · b45ce395
      Alessio Netti authored
      - String topics are now used across all of DCDB, up to Cassandra
      - As of now, sensor names ALWAYS match MQTT topics
      - Users can still define sensor "aliases" via dcdbconfig that point
      to the same topics
      b45ce395
  13. 24 May, 2019 2 commits
  14. 23 May, 2019 1 commit
  15. 22 May, 2019 1 commit
    • Alessio Netti's avatar
      Minor changes · 8810a787
      Alessio Netti authored
      - Fixed name of log files for collectagent
      - Fixed a few compilation warnings under gcc 7
      - README for dcdbpusher now correctly refers to dcdbpusher.conf files
      - SensorNavigator is rebuilt after plugin reloads only if data analytics
      are currently running
      8810a787
  16. 14 May, 2019 1 commit
  17. 09 May, 2019 1 commit
  18. 02 May, 2019 1 commit
    • Alessio Netti's avatar
      REST API fixes for topics · 1ee72f08
      Alessio Netti authored
      - By convention, users should supply '.' characters instead of '/' when
      querying sensor topics over the REST API to avoid conflicts with URL
      parsing; the characters are then replaced automatically in the server
      1ee72f08
  19. 30 Apr, 2019 1 commit
  20. 29 Apr, 2019 1 commit
    • Alessio Netti's avatar
      DA: filter for SensorNavigator and binary search fixes · f2970bda
      Alessio Netti authored
      - a "filter" configuration parameter has been added, which is used
      to discard sensor names when building the sensor navigator
      - Can be used to e.g. build a sensor navigator in a collectagent
      using only the sensors that are directly collected by it
      - Implemented a switch to select leftmost/rightmost binary search
      in CacheEntry, used for the QueryEngine
      f2970bda
  21. 24 Apr, 2019 2 commits
    • Alessio Netti's avatar
      Configuration tweaks · 8b4b1738
      Alessio Netti authored
      - Parsing of host:port network addresses is handled by GlobalConfiguration
      - -p dcdbpusher command line parameter (broker port) removed and integrated
      into the -b argument
      8b4b1738
    • Alessio Netti's avatar
      Unified configuration backend · 0b344fc2
      Alessio Netti authored
      - The GlobalConfiguration class includes all shared logic to read and
      parse configuration attributes for the collectagent and dcdbpusher
      - The class is further expanded to add application-specific
      configuration parameters and blocks
      0b344fc2
  22. 23 Apr, 2019 1 commit
    • Alessio Netti's avatar
      DA: search-based sensor queries · eb186235
      Alessio Netti authored
      - When performing sensor queries with absolute timestamps (rel=false) a
      binary search algorithm is used to compute the bounds of the required
      sensor cache view
      - This is more accurate than the fuzzy method employed with relative
      timestamps (rel=true)
      eb186235
  23. 18 Apr, 2019 1 commit
    • Alessio Netti's avatar
      DA: REST API in collectagent · 0466b434
      Alessio Netti authored
      - The REST API of the data analytics framework is now functional in
      the collectagent as well
      - This implementation is temporary and should be replaced with a generic
      REST API server whenever possible
      0466b434
  24. 15 Apr, 2019 2 commits
    • Alessio Netti's avatar
      DA: data staleness checks · e19fd249
      Alessio Netti authored
      - Batch size in the collectagent now taken into account to determine if
      a specific sensor cache is stale or not
      e19fd249
    • Alessio Netti's avatar
      DA: bugfixes and documentation · 35cfab1b
      Alessio Netti authored
      - Integration of data analytics framework in collectagent complete
      - REST API integration still pending
      - Added some documentation to the code
      35cfab1b
  25. 12 Apr, 2019 2 commits
    • Alessio Netti's avatar
      DA: integration of analytics in collectagent · 30c355d3
      Alessio Netti authored
      - QueryEngine integration done (but not functional yet, debugging required)
      - Changed behavior on exceptional conditions: if SensorNavigator or
      AnalyticsManager initialization fails, termination follows
      - Now the QueryEngine can also access output sensors of other Analyzers
      - Minor bugfixes
      30c355d3
    • Alessio Netti's avatar
      DA: integration in CollectAgent (WIP) · 0f77d784
      Alessio Netti authored
      - First step for integration of the analytics framework in the collectagent
      - QueryEngine and REST API integration still missing
      - Proper testing still to be done
      - Added a probe function: the global config file is scanned before
      initialization, and if no data analytics plugins are requested, no
      sensor navigator is built
      0f77d784
  26. 13 Mar, 2019 2 commits
    • Alessio Netti's avatar
      eb38c300
    • Alessio Netti's avatar
      Minor refinements · abf6af19
      Alessio Netti authored
      - Boolean configuration options now all accept "true" and "on" keywords
      - Cache interval and thread count parameters removed from the command-line
      interface for consistency; these can still be set in the config files
      like all other parameters
      - global.conf file renamed to dcdbpusher.conf for consistency
      abf6af19
  27. 11 Mar, 2019 1 commit
    • Alessio Netti's avatar
      Sensor cache changes · 06155b53
      Alessio Netti authored
      - Sensor caches across DCDB are now managed by the CacheEntry
      implementation under "common"
      - Provides utility methods to perform averages, checks, get views etc.
      - SensorCache class in collectagent kept due to its libdcdb dependencies
      06155b53
  28. 07 Mar, 2019 1 commit
    • Alessio Netti's avatar
      Code refactoring (make clean required) · d35348f7
      Alessio Netti authored
      - Added a 'common' directory where all shared code has been placed
      - Analytics package has been moved out of dcdbpusher, now has its own makefile
      - Some renaming here and there for uniformity
      d35348f7
  29. 01 Mar, 2019 1 commit
    • Alessio Netti's avatar
      Minor changes · 2cf6acc5
      Alessio Netti authored
      - Fixed a minor issue that caused text corruption when using the -h
      option on certain shells
      - Collectagent now exits gracefully also when receiving a SIGTERM signal
      2cf6acc5
  30. 26 Feb, 2019 1 commit
    • Alessio Netti's avatar
      Configurable Cassandra Driver · a7f9b57c
      Alessio Netti authored
      - Added configuration options to tune the Cassandra driver for
      optimal performance
      - Added a "debugLog" configuration switch that enables logging of
      errors in asynchronous inserts in the Cassandra driver
      a7f9b57c
  31. 25 Feb, 2019 1 commit
    • Alessio Netti's avatar
      Automatic cache cleanup · 05e98971
      Alessio Netti authored
      - The CollectAgent sensor cache is automatically purged each X seconds
      (X is configurable through the cleaningInterval parameter), deleting
      all entries than have not been updated in the last X seconds
      - Fixed some minor bugs related to index management in sensor caches
      05e98971
  32. 19 Dec, 2018 1 commit