v0.5.2

Changelog

• f28a2fc Merge pull request #41 from kmetaxas/feature/list_topics_cli
• b23a8fc fix go-releaser action
• 9ba69ef add topics list command

v0.5.1

Changelog

• 88e5afa Merge pull request #39 from kmetaxas/fix/pprint_display_part
• 035f125 try to deserialize string as json before printing as json to make it nice.
• cbf8d09 fix Println with formatting to Printf
• b7e9fdb fix cli switch and use printerfunc
• 12898df add support for JSON output
• d513b0a display Partition in prettyPrint and make Value prefix same as key prefix
• 321eafc Merge pull request #38 from LD250/bugfix/allow-null-keys
• c254bb5 Do not serialize null keys
• 4dccbdd upgrade to codeql v2

v0.5.0

Changelog

• 37f1b7a Merge pull request #37 from kmetaxas/fix/mds_fix_ssl
• a9a709b add tls support for metadataserver
• 30e3d38 Merge pull request #36 from kmetaxas/feature/tokenauth
• 2f4a963 move the saramconfig from kafkaconfig to config.go
• 230f858 add Token authentication support
• 0429880 Merge pull request #35 from kmetaxas/feature/saslplain
• c6378ed update documentation about sasl plain support
• 49c5271 add saslplain support
• 4cebdfc don't try to retrieve connectors if connectadmin is not created
• 30edb40 Merge pull request #34 from kmetaxas/fix/consumergroup_rebalance_handler
• 5e540d5 add sarama_logger
• 592d322 switch to case handling of ConsumeClaim

v0.4.1

Changelog

• 26f3386 Merge pull request #33 from kmetaxas/fix/make_admin_clients_optional
• 53f9b4e don't crash if MDS connection is undefined
• 4cf4205 Merge pull request #32 from kmetaxas/fix/tls_settings_consumer
• e6fd928 consumer instantiation now creates http client with TLS transport as per settings
• 5eeb156 testadminclients unit test is broken and requires testcontainers which is not ready
• 67e279e increase test coverage. Bump Sarama to 1.38
• 99c4283 add some unit tests for topic linter
• f81ab68 Merge pull request #29 from thbounzer/master
• 983e526 Update documentation according to what was implemented in code
• 086cee2 Merge pull request #28 from kmetaxas/fix/serialized-console-writer
• fabee90 use serialized writer for console output
• 2d5973a Don't put extra dashes in subject. Fix #27
• 130622b fix template not to display unneeded context

v0.4.0

Changelog

• 1bfb050 Merge pull request #24 from kmetaxas/feature/sops-inputyaml
• 76f1f74 allow setting a regex for senstive keys and mask them in the output
• 651ae91 refactor report to allow more configurability
• 05bbcfa sops decrypt input YAML as well, as connectors can contain sensitive info
• 8063d99 Merge pull request #23 from kmetaxas/feature/connector-config
• 167b151 minor README update
• 1593ddc minor doc update
• 2790e44 minor fixes for logging and staticheck
• c7f15ec display validation errors in result template (plan)
• c071ec4 Only update connectors if different from existing config. Show result of connector apply
• f25d8a4 List connector-plugins on the CLI
• e680c49 prettify the expanded version of connector listing
• b13a883 update connector template to display old config only in changed configs
• ba73b41 use string only for config values. Update reports
• 3198cf3 minor change do sample yaml
• 333eacf Merge branch 'master' into feature/connector-config
• 98fcdc5 Update unit reports unit test to also call with dry_run=false
• 4f1b8c2 add sample connector config in data/sample
• 8e23666 add plan/apply functionality and change DoSync and get admins functions
• ff9f71a use json.RawMessage fro Connector
• 70c6b05 fix typo in tag name
• bc91ce5 add connector support in YAML, add update code.

0.3.0

Changelog

• 6265f6a update report console template to properly display schema changes
• 4f83832 fix bug not identifying new compat in report. add unit test for reports
• 99def9b upgrade sarama+yaml dependencies. display replicationfactor and partitioncount in report
• 1d4eb43 Merge pull request #22 from kmetaxas/fix/consumer-nullvalue
• e0e2b27 update the displayed string for null values
• f13b6b5 check for null values and emit a message
• fc3cc39 change comment to indicate that schema caching is done by srclient library
• 5650331 Merge pull request #20 from kmetaxas/feature/transactionalid
• 3d388ac Merge branch 'master' into feature/transactionalid
• f7f9a48 update go version in github actions to 1.18
• e1e8452 fix Trace with formatting to be Tracef
• e471833 updated sops dependency
• 48157cf add support for transactionalId , same style as consumer group permissions
• 3d4b5c7 Merge pull request #18 from kmetaxas/feature/topic-describe
• e0ee831 add documentation for topic describe
• c54a2d7 Switch to using a template for topic describe command output
• 583c055 Add cli command to describe a topic
• b172883 Merge pull request #16 from kmetaxas/fix/tls-sr
• 7e9ea93 add proper support for TLS config in schemaregistry client
• fcba453 fix topic lint rule assigning severity to hint
• 2575ce7 lint error if min ISR >= replicationFactor for a topic
• f0e5203 add a flag to only show error level lint results for broker-lint
• f7f42c4 Merge pull request #15 from kmetaxas/feature/kafka-topic-sanity
• d625a24 update documentation for lint-broker
• 8519ef1 Add lint-broker command to run lint against broker topics
• b2130ca fix unknown verb of Tracef

v0.2.1

Changelog

• 826af08 Fix bug that registered compatibility setting even when not needed
• 40f774a upgrade to sops v3.7.2
• c17166f update readthedocs link in README

v0.2.0

Changelog

• 32c1c44 Merge pull request #13 from kmetaxas/feature/fastsr
• 131c594 point to readthedocs. update doc for skipRegistryForReads
• c5594a6 minor changes to fix staticcheck warnings
• 84c20ca fix LookupSchemaForSubject to not lookup against its own schema
• dda7249 Merge branch 'master' into feature/fastsr
• e0d99ef Merge pull request #14 from kmetaxas/feature/loglevels
• b69c934 add some debug/trace statements
• 8e71e2c Add verbosity option.
• 1cbeecd switch to logrus for log statements
• b1d13ef make use of SchemaRegistryCache optional in Config
• 2e571fd provide cached alternative to /subjects. compare compats usign same case
• 8469dcc update schemaregistry code to use kafka _schemas version
• 106eabc merge master
• e9afc7a comment out read requests for schemaregistry and replace with Vrooom
• 161420a fix bug reaching the end of _schemas topic. Handle tombstones
• 070f41b remove subjectcacheentry
• 277bbe4 fix client<->ConsumerGroup objects in consumer. Read schemas until current end
• 811c6fc update result template to not merge subject lines
• 93f1ff0 Merge branch 'master' of github.com:kmetaxas/gafkalo
• a99cbdb update to srclient 0.4.3 with upstream for logicalType decimal.
• a1e64b2 Merge pull request #12 from kmetaxas/fix/nosetcompat
• 219252e rewrite compat settings to simplify and only change when needed. Fix template bug reporting schema changes when only compat changed
• 94d64f1 Merge branch 'master' into feature/fastsr
• 436e268 parse SCHEMA keys+values and add them to internal state
• f0287f4 use provided consumerGroupHandler in Consume() method
• 0a614f8 Merge branch 'master' into feature/fastsr
• 6a3b9f5 add support for reading the _schemas topic

v0.1.1

Changelog

• 8618768 Merge pull request #11 from kmetaxas/fix/sr-compat-recreated
• ebd34f2 Properly display compatibility settings
• 1a22138 Merge pull request #9 from kmetaxas/feature/connect
• d5a1ce9 add color out put to health-check and use stderr for error
• c789520 Merge branch 'master' into feature/connect
• eb4bde7 Merge pull request #10 from kmetaxas/feature/timeout
• 91e7eb0 allow user to set a Timeout for REST calls to schemaregistry.
• 91531ff add a quick health-check CLI command for connect
• be16566 revert regression with Partition count. Use broker IDs from cluster instead of assuming they are sequential
• 8502759 don't subtract existing partition count from count param when calculating new partitioning scheme

v0.1.0

Changelog

f5d1519 add goreleaser yml
70c7ec8 partition increase will now assign non-repeating broker IDs from the available broker set
7c3502f fix off-by-one error in setting broker IDs for partitioning json
1f353fe fix calculate partitions method and add unit test for it
e1c3aed reverse the schema mustRegister logic as it is buggy
4e1f49b don't try to register if schema exist but is not latest version. Fixes issue #8
cdacac9 add missing Consumer Group RBAC functionality
d5cbc83 bump sarama
4ab67ac Droneci move helm params inside settings key
7003605 modift drone ci pipeline to use kube token from secret
539efd6 add docs for sops encryption
ada04a2 fix some staticcheck warnings (mostly log message formatting)
8c3a0aa Merge pull request #7 from kmetaxas/feature/sops
92fe09c allow using plaintext config in case of MetadataError in sops
1521e33 add support for sops encrypted config file
1231a1b update to v0.4.2 of kmetaxa/srclient fork
840c669 use a forked srclient that works with schema registry <5.4.x
cd068b2 Merge pull request #6 from kmetaxas/feature/connect
d43852b add support for restarting (heal) failed connectors+tasks
b5e0cf1 add .gitignore
28926db add support for TLS config
76f591d add option to remove connector. Remove param from create option that is not needed. Switch to args for name option
a40e550 allow creating connector
fc13f70 remove test from default all target in Makefile
58afb98 slight modification to sample data
c76d06f switch to environment method for helm task of DroneCI
4771b60 add kube_api_server command as well to DroneCI pipeline
34b697a update drone CI pipeline for docs
bb4203b update documentation for installation and usage
312f5e1 Merge branch 'master' of github.com:kmetaxas/gafkalo
9f20487 update readme with license text
896ce1f Merge pull request #5 from kmetaxas/add-license-1
e7fd276 Create LICENSE
f8de23c Merge pull request #4 from kmetaxas/feature/replicate
2c6ba61 update documentation for replicator
af7098d add consumer group id parameter and default for replicator
b872afd added replicator CLI command and basic replication function
13da24d change PRoducer to use a consumerGroupHandler that can be user supplied if neeeded
2738984 display which schema ID failed to be retrieved as Schema registry does not return good enough errors
5b39d4b Merge pull request #3 from kmetaxas/feature/producerconf
99101f8 remove unused import
d8c232b add support for producer configs and producing file blobs
5bc32a6 use tables to display connect describe
f314f02 add a consumergroup cli that can do basic describe and list. switch some connect to use tables
2197b81 update test data
5229e99 remove unused Task type and small fixes for staticcheck
4fd3489 split cli to multiple files to reduce confusion
2fbfa89 add option to produce tombstone messages
972fd44 split connector info into top level struct, describe connector details
e70d7d4 add initial support for connector management. Only list and describe is in for now
f50a3ad add link to docs
d7b8545 add helm stage in Drone pipeline
35c55e8 update dockerfile location for Drone pipeline
9e5d9ea move docs/Dockerfile to Dockerfile.docs
fe66625 drone pipeline point to docs Dockerfile
21f8e51 add registr field in drone pipeline
cae720b update docker task pipeline to reflect cert
7386494 add debug and commit id to drone pipeline
47dd514 rename step
6e4e382 update drone pipeline
9a6ef0c add sample Drone CI pipeline for docs
f46d697 black formatting on sphinx conf.py
ead72d7 update usage docs
7919089 fix broken message limit
01256ca properly seed randomstring as we were getting the same consumer id
e230574 update docs
da80ca7 change schema reconcile to not try and updte if SchemaData is empty string
5a494b0 add support for schema DIFF
7beeffe don't sent schemaType if if AVRO to maintain compatibility with pre 5.5 CP platform
8d1471a update readme
794be88 add support for user-defined golang templates when printing kafka records
014b021 add small test for cli
9810347 fixes according to outpit of staticcheck
be5e2e5 Add support for setting partition+offset.
26b340b add support to read from beginning on consumer
12493d0 add linter for min isr
f787dc3 add basic linter for definitions. Add WIP schema diff support
57aadf5 add support for IdempotentWrite cluster role
eefcc3b add schemas check-exists command to check if a schema file is registered under a subject
5bf38ef Merge branch 'master' of github.com:kmetaxas/gafkalo
9023202 fix errors reported by staticcheck
c817dcc fix bug were doProducer was called instead of doResourceOnerFor
0fa962c Create codeql-analysis.yml
8316334 update docs
add8ced add documentation
cc45234 fix bug #2
ce6bd92 add support for schema registry to consumer
439ea35 Don't choke if key/value sparator is missing in input
8f17028 split serializer into smaller functions
828751d add schema registry support to Producer
2dde097 don't try to create a schema if a null/empty path is given
ab57003 fix relative schema definitions
1864057 add basic consumer support
619fba7 add basic consumer support (based on Sarama's consumergroup example)
658dbb7 test roleExists()
8bf4c66 use go-cmp to compre structs in config
944c8e6 rename test->testdata
b6d61c6 add test data files
b489743 add more small unit tests for configuration and results
c579d9f add a few more tests for clients.
35fa3a7 switch getPrefixStr to not be a method. Add a couple small unit tests
07cbcbf switch to go.16 in the pipeline
ca4b297 add support to TlsConfig for MDS+Schamregistry. Change SR config from map to struct
bbc0902 fix bug in client result plan
6bd837e changed to and invert the logic to match golang bool default
5766ee6 add helper to report of topic will hae default configs
bc1e72e embed template file
46ff2f0 always set username when gssapi is used
5422af5 allow option for keytab auth
9f6fdd8 commit go.sum
aecb6bb rename module name to reflect github
1557380 add a stub test and fix pipeline
bfd038e Create go.yml
6a37e52 remove unused import, fixes build
83b4b17 add configuration options to enable kerberos and to add CA certs to trust
e5ecbc5 update partitions and reflect this in results
0dcce08 fix clients to add ClientResult if dryrun
699df92 update console template to look a little better
b8f0ef3 Compare string content of configs, not pointer valies. Duh
85e1015 ignore topic configs that don't change from result
2d2ecd4 fix broken topicdiff
a0d0bff don't alter configs for topics unless needed
437dcad Check if role exists and don't create or add in the plan
5b9fe0c merge client from multiple yaml
94f9513 don't call alterconfigs in new topics
4a8920c fix broken dryrun logic
40af567 add some schema template and fix dryrun for topics
5e174ed switch to Kong cli tooling
c31ef7f add support for client and reports
bf7c49a comment on iota values
1fbefca add initial support for client config
a1b2893 fill TopicResult with correct previous values
958be97 update readme
6a1efec initial commit in new repo