Before you file an issue, please search existing issues in case it has already been filed, or perhaps even fixed. If you file an issue, please include the following.
- Full details of your operating system (or distribution) e.g. 64-bit Ubuntu 14.04.
- The version of Kapacitor you are running
- Whether you installed it using a pre-built package, or built it from source.
- A small test case, if applicable, that demonstrates the issues.
Remember the golden rule of bug reports: The easier you make it for us to reproduce the problem, the faster it will get fixed. If you have never written a bug report before, or if you want to brush up on your bug reporting skills, we recommend reading Simon Tatham's essay "How to Report Bugs Effectively."
Please note that issues are not the place to file general questions such as "how do I use InfluxDB with Kapacitor?" Questions of this nature should be sent to the Google Group, not filed as issues. Issues like this will be closed.
We really like to receive feature requests, as it helps us prioritize our work. Please be clear about your requirements, as incomplete feature requests may simply be closed if we don't understand what you would like to see added to Kapacitor.
Kapacitor follows standard Go project structure.
This means that all your go development are done in $GOPATH/src.
GOPATH can be any directory under which InfluxDB and all its dependencies will be cloned.
For more details on recommended go project's structure, see How to Write Go Code and
Go: Best Practices for Production Environments, or you can just follow the steps below.
To submit a pull request you should fork the Kapacitor repository, and make your change on a feature branch of your fork. Then generate a pull request from your branch against master of the Kapacitor repository. Include in your pull request details of your change -- the why and the how -- as well as the testing your performed. Also, be sure to run the test suite with your change in place. Changes that cause tests to fail cannot be merged.
There will usually be some back and forth as we finalize the change, but once that completes it may be merged.
To assist in review for the PR, please add the following to your pull request comment:
- [ ] CHANGELOG.md updated
- [ ] Rebased/mergable
- [ ] Tests pass
- [ ] Sign [CLA](http://influxdb.com/community/cla.html) (if not already signed)A third-party package is defined as one that is not part of the standard Go distribution. Generally speaking we prefer to minimize our use of third-party packages, and avoid them unless absolutely necessarily. We'll often write a little bit of code rather than pull in a third-party package. So to maximise the chance your change will be accepted by us, use only the standard libraries, or the third-party packages we have decided to use.
For rationale, check out the post The Case Against Third Party Libraries.
If you are going to be contributing back to Kapacitor please take a second to sign our CLA, which can be found on our website.
Kapacitor requires Go 1.6 or greater.
To install go see https://golang.org/dl/
Go has the ability to import remote packages via revision control systems with the go get command. To ensure that you can retrieve any remote package, be sure to install the following rcs software to your system.
Currently the project only depends on git and mercurial.
Setup the project structure and fetch the repo like so:
mkdir $HOME/go
export GOPATH=$HOME/go
go get github.com/influxdata/kapacitor
You can add the line export GOPATH=$HOME/go to your bash/zsh file to be set for every shell instead of having to manually run it everytime.
If you wish to work with fork of Kapacitor, your own fork for example, you must still follow the directory structure above. But instead of cloning the main repo, instead clone your fork. Follow the steps below to work with a fork:
export GOPATH=$HOME/go
mkdir -p $GOPATH/src/github.com/influxdata
cd $GOPATH/src/github.com/influxdata
git clone [email protected]:<username>/kapacitor
Retaining the directory structure $GOPATH/src/github.com/influxdata is necessary so that Go imports work correctly.
We have a pre-commit hook to make sure code is formatted properly and vetted before you commit any changes. We strongly recommend using the pre-commit hook to guard against accidentally committing unformatted code. To use the pre-commit hook, run the following:
cd $GOPATH/src/github.com/influxdata/kapacitor
cp .hooks/pre-commit .git/hooks/
In case the commit is rejected because it's not formatted you can run the following to format the code:
go fmt ./...
go vet ./...
NOTE: If you have not installed mercurial, the above command will fail. See Revision Control Systems above.
For more information on go vet, read the GoDoc.
Make sure you have Go installed and the project structure as shown above. To then build the project, execute the following commands:
cd $GOPATH/src/github.com/influxdata/kapacitor
go build ./cmd/kapacitor
go build ./cmd/kapacitordKapacitor builds two binares is named kapacitor, and kapacitord.
To run the tests, execute the following command:
go test $(go list ./... | grep -v /vendor/)Kapacitor vendors all dependencies. Kapacitor does not use a dependency manager tool, but rather uses git subrepos to place dependencies in the vendor directory. This give complete control over how dependency are managed and keeps the workflow simple. A few helper scripts are provided to make this process fast and easy.
To manage the subrepo you must first install git-subrepo.
First list all dependencies, including dependencies of dependencies.
./list-deps
To add a new dependency add a new entry to the vendor.list file, of the form:
<package> [branch]
The branch column is optional.
If branch is left empty the default branch will be used.
For example, to add the github.com/influxdata/foo/bar dependency add this line to the vendor.list.
github.com/influxdata/foo https://github.com/influxdata/foo.git
Notice that bar part of the path was left off since its a subdirectory of the repo.
Commit this change then run:
./vendor.sh github.com/influxdata/foo
This will add the subrepo for the git repo under vendor/github.com/influxdata/foo.
Later to update the dependency use the same command.
./vendor.sh github.com/influxdata/foo
Or to update all dependencies at once use
./vendor.sh
These scripts are really simple, we may formalize them later but currently simplicity is key.
Kapacitor uses generated code. The generated code is committed to the repository so normally it is not necessary to regenerate it. But if you modify one of the templates for code generation you must re-run the generate commands.
Go provides a consistent command for generating all necessary code:
go generate ./...For the generate command to succeed you will need a few dependencies installed on your system:
- tmpl -- A utility used to generate code from templates. Install via
go get github.com/benbjohnson/tmpl - protoc + protoc-gen-go -- A protobuf compiler plus the protoc-gen-go extension.
You need version 3.0.0-beta-2 of protoc.
To install the go plugin run
go get github.com/golang/protobuf/protoc-gen-go
NOTE: Since installing dependencies can often be painful we have provided a docker container that comes with all of these dependencies installed. See the section below about the build script and docker.
The above commands have all be encapsulated for you in a build.py script.
The script has flags for testing code, building binaries and complete distribution packages.
To build kapacitor use:
./build.pyTo run the tests use:
./build.py --testIf you want to generate code run:
./build.py --generateIf you want to build packages run:
./build.py --packagesThere are many more options available see
./build.py --helpKapacitor requires a few extra dependencies to perform certain build actions.
Specifically to build packages or to regenerate any of the generated code you will need a few extra tools.
A build.sh script is provided that will run build.py in a docker container with all the needed dependencies installed with correct versions.
All you need is to have docker installed and then use the ./build.sh command as if it were the ./build.py command.
When troubleshooting problems with CPU or memory the Go toolchain can be helpful. You can start InfluxDB with CPU or memory profiling turned on. For example:
# start kapacitord with profiling
./kapacitord -cpuprofile kapacitord.prof
# run task, replays whatever you're testing
# Quit out of kapacitord and kapacitord.prof will then be written.
# open up pprof to examine the profiling data.
go tool pprof ./kapacitord kapacitord.prof
# once inside run "web", opens up browser with the CPU graph
# can also run "web <function name>" to zoom in. Or "list <function name>" to see specific linesNote that when you pass the binary to go tool pprof you must specify the path to the binary.
Kapacitor uses CircleCI for continuous integration testing.
- Useful techniques in Go
- Go in production
- Principles of designing Go APIs with channels
- Common mistakes in Golang. Especially this section
Loops, Closures, and Local Variables