Skip to content

An ubuntu-slim/s6-overlay/confd based docker image for running fluentd in Kubernetes pods/daemonsets

Notifications You must be signed in to change notification settings

mumoshu/kube-fluentd

Folders and files

NameName
Last commit message
Last commit date

Latest commit

76d5f7b · Feb 27, 2018

History

51 Commits
Jan 17, 2018
Jan 17, 2018
Nov 30, 2017
Jul 15, 2016
Jul 12, 2016
Dec 20, 2017
Feb 27, 2018
Dec 8, 2017
Dec 9, 2016
Dec 7, 2017
Jan 17, 2018
Nov 13, 2017
Feb 27, 2018

Repository files navigation

kube-fluentd

Build Status

Docker Hub

A docker image for running fluentd in Kubernetes pods.

Based on:

Supported tags

  • latest/0.14.22-0.9.9 (Fluentd v0.14.22)

Naming convention for images is $FLUENTD_VERSION-$KUBE_FLUENTD_VERSION

Changelog

  • 0.9.10-rc.17
    • Bump Fluentd to 1.0.0
    • Support for Datadog Log Management
    • Expose Prometheus metrics
  • 0.9.10-rc.1
    • Bump Fluentd to 0.14.22
    • Support for credentials from volume mounts (See fluentd.daemonset.credfromfile.yaml)
  • 0.9.9
  • 0.9.8
    • Set buffer_queue_full_action to block for tail plugins so that we won't drop messages anymore
  • 0.9.7
    • fluentd.conf is customizable via environment variables (#3, thanks to @cw-hayashi)
  • 0.9.6
    • Fix the fluentd OOM issue when ingesting a lot of log
  • 0.9.5
    • Remove /var/lib/apt/lists/* to save approximately 20MB of image size
  • 0.9.4
    • Build confd outside of containers to save 1MB of image size
  • 0.9.3
    • Switch from alpine to ubuntu-slim:0.4
    • Use jemalloc
    • Fluentd 0.14.9
  • 0.9.2
  • 0.9.1

Usage in Kubernetes

(1) Create a new GCP service account key in https://console.cloud.google.com/apis/credentials and obtain ${gcp_project_name}-${service_account_key_id}.json1

(2) Run the following commands:

For Google Stackdriver Logging:

$ cp ${gcp_project_name}-${service_account_key_id}.json application_default_credentials.json
$ kubectl kubectl create secret generic kube-fluentd-google-application-default-credentials --from-file application_default_credentials.json --namespace kube-system
$ kubectl create -f fluentd.rbac.yaml
$ kubectl create -f fluentd.daemonset.credfromfile.yaml

For Datadog Log Management:

$ kubectl create secret generic datadog --from-literal=api-key=$DD_API_KEY
$ kubectl create -f fluentd.rbac.yaml
$ kubectl create -f fluentd.datadog.daemonset.yaml

About

An ubuntu-slim/s6-overlay/confd based docker image for running fluentd in Kubernetes pods/daemonsets

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published