dstat-redis.cr v0.4.7

Store dstat output into redis as JSON string
  • v0.4.7 - February 8, 2017
  • v0.4.6 - January 12, 2017
  • v0.4.4 - December 13, 2016
  • v0.4.3 - November 9, 2016
  • v0.4.2 - October 25, 2016

dstat-redis Build Status

Store dstat output into redis as JSON string.

Features

  • Handy : just one x86_64 binary (no fluentd or Ruby needed)

Config

  • edit config.toml
verbose = false

[dstat]
prog = "dstat"
args = "-clmdny --tcp"

[redis]
host = "127.0.0.1"
port = 6379
# pass = "secret"

cmds = [
  "SET dstat __json__",
]

[log]
interval_sec = 3
time_format = "%Y-%m-%d %H:%M:%S"

Dynamic Value

  • __json__ : a runtime dstat data as JSON
  • __host__ : a running host name
  • __XXXX__ : a dstat value correspond to the field (ex. __epoch__)
  • __%Y%m__ : keywords that starts with '%' will be passed to strftime(3) with dstat[epoch]

Usage

basic

  • Running with default config.toml puts json to redis://localhost:6379/dstat
  • Get and jq as you like! For example, show current Used Memory and TIME_WAIT socket.
% dstat-redis config.toml &
% redis-cli --raw GET dstat | jq .used,.tim
"1193M"
"14"

pub/sub

  • vi config.toml (add "PUBLISH" command)
cmds = [
  "SET     dstat __json__",
  "PUBLISH dstat __json__",
]
% dstat-redis config.toml &
% redis-cli --raw SUBSCRIBE dstat
subscribe
dstat
1
message
dstat
{"usr":1,"sys":1,"idl":98,"wai":0,"hiq":0,"siq":0,"1m":0.34,"5m":0.2,"15m":0.14,"used":663000000,"buff":356000000,"cach":788000000,"free":193000000,"read":0,"writ":16000,"recv":1740,"send":1320,"int":374,"csw":474,"lis":19,"act":19,"syn":0,"tim":2,"clo":0,"epoch":1472404633}
  • Oh, it's noisy. Body Template will be good use for this case.
cmds = [
  "PUBLISH dstat mem:__used__,disk(in=__read__,out=__writ__)",
]
% dstat-redis config.toml -v
Connecting 127.0.0.1:6379 ... OK
debug: ["PUBLISH", "dstat", "mem:1213000000,disk(in=676,out=33000)"]
...

store as epoched stats for one day

  • vi config.toml (add "ZADD" command)
  • NOTE: ZADD CH option needs Redis 3.0.2 or higher
cmds = [
  "ZADD   dstat/__host__/__%Y%m%d-%H__ CH __epoch__ __json__",
  "EXPIRE dstat/__host__/__%Y%m%d-%H__ 86400",
  "SADD   dstat/__host__ __%Y%m%d-%H__",
]
% dstat-redis config.toml -v
debug: ["ZADD", "dstat/ubuntu/20160829-23", "CH", "1472480308", ...]
debug: ["SADD", "dstat/ubuntu", "20160829-23"]

% redis-cli SMEMBERS dstat/ubuntu
1) "20160829-23"

# We can find heavy HDD `writ` on some period between epoch1 and epoch2.
# For instance, the hostname is `ubuntu` and the period is between 1472480308 and 1472480310.
% redis-cli --raw ZRANGEBYSCORE "dstat/ubuntu/20160829-23" 1472480308 1472480310 | jq .writ | sort -nr | head
60000
16000
6866

Restrictions

  • json : Duplicated keys would be exist (not a valid JSON format)
    • ex: (mem)used and (swap)used -> {"used":"10KB",...,"used":"0"}

Roadmap

0.5

  • Other Formats

1.0

  • Independent from dstat

Contributing

  1. Fork it ( https://github.com/maiha/dstat-redis/fork )
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create a new Pull Request

Contributors

  • maiha maiha - creator, maintainer
Owner
github statistic
  • 1
  • 0
  • 1
  • 0
  • 10 days ago
  • August 26, 2016
License

MIT License

Links
Synced at

Tue, 02 Jun 2020 06:16:41 GMT