Fluentd is a data collector for unified logging layer, it can be configured with the Loki output plugin, provided in this folder, to ship logs to Loki.
See docs/client/fluentd/README.md for detailed information.
After checking out the repo, run bin/setup to install dependencies. Then, run bundle exec rake spec to run the tests. You can also run bin/console for an interactive prompt that will allow you to experiment.
To install this gem onto your local machine, run bundle exec rake install. To release a new version, update the version number in fluent-plugin-grafana-loki.gemspec, and then run bundle exec rake release, which will create a git tag for the version, push git commits and tags, and push the .gem file to rubygems.org.
To create the gem: gem build fluent-plugin-grafana-loki.gemspec
Useful additions:
gem install rubocop
Start Loki using:
docker run -it -p 3100:3100 grafana/loki:latest
Verify that Loki accept and stores logs:
curl -H "Content-Type: application/json" -XPOST -s "http://localhost:3100/loki/api/v1/push" --data-raw "{\"streams\": [{\"stream\": {\"job\": \"test\"}, \"values\": [[\"$(date +%s)000000000\", \"fizzbuzz\"]]}]}"
curl "http://localhost:3100/loki/api/v1/query_range" --data-urlencode 'query={job="test"}' --data-urlencode 'step=300' | jq .data.result
The expected output is:
[
{
"stream": {
"job": "test"
},
"values": [
[
"1588337198000000000",
"fizzbuzz"
]
]
}
]
Start FluentBit + Fluentd using:
LOKI_URL=http://{{ IP }}:3100 make fluentd-test
Verify that syslogs are being feeded into Loki:
curl "http://localhost:3100/loki/api/v1/query_range" --data-urlencode 'query={job="fluentd"}' --data-urlencode 'step=300' | jq .data.result
The expected output is:
[
{
"stream": {
"job": "fluentd"
},
"values": [
[
"1588336950379591919",
"log=\"May 1 14:42:30 ibuprofen avahi-daemon[859]: New relevant interface vethb503225.IPv6 for mDNS.\""
],
...
]
}
]
- Copyright(c) 2018- Grafana Labs
- License
- Apache License, Version 2.0