The format is based on Keep a Changelog and this project adheres to Semantic Versioning.
- Support for null item lists, courtesy of @ueisele
- Escaping headers' colons
- Added implementation to parse substring as timestamp field
- Bugfix #82: NPE when commit before ever polling. Happening on long initial polls
- FreeMarker number representation as "computer" by default, offset.timestamp explicitly documented as ISO8601 format, elasticsearch example updated accordingly
- Fix ConfluentHub package
- Handle records committed out of order
- Project restructured to enable integration testing
- Provided different log levels for
OkHttpClient
.TRACE
:BODY
,DEBUG
:BASIC
,*
:NONE
- Refactored throttler adding the notion of timer
- Support for authentication extension. Initial implementations for None and Basic authentication types
- Fix typo in
http.throttler.catchup.interval.millis
configuration property - Change default polling interval to 60s and 30s when catching up
- Fix castorm#22: build fails with jdk 11
- Simplify
SchemedKvSourceRecordMapper
by removing irrelevant configuration - Add log INFO with offset and results per poll iteration
- Avoid storing default timestamp in
Offset
to better manage the scenario in which connector config goes from not specifyinghttp.response.record.timestamp.pointer
to specifying one - Remove
BytesKvSourceRecordMapper
before it gets actually used for considering it redundant SchemedKvSourceRecordMapper
to produce a value with key and timestamp- Implement a
SourceRecordSorter
to enable support of HTTP resources with reverse order of records
- Provide
BytesKvSourceRecordMapper
to avoid both the envelope wrapping key and value and the escaped encoding of the json document
- Provide
StringKvSourceRecordMapper
to avoid the envelope wrapping key and value
timestamp_iso
key inOffset
renamed to plaintimestamp
key
added toOffset
JacksonKvRecordHttpResponseParser
to generate a consistentUUID
as key when key is missingAdaptableIntervalThrottler
to skip throttling on first requestSimpleKvSourceRecordMapper
to support custom key/value property names
http.response.records.pointer
renamed tohttp.response.list.pointer
http.response.record.value.pointer
renamed tohttp.response.record.pointer
- Enable compound keys on
JacksonRecordParser
- Change default value for
http.response.record.timestamp.parser.pattern
fromyyyy-MM-dd'T'HH:mm:ss.SSSX
toyyyy-MM-dd'T'HH:mm:ss[.SSS]X
- Rename plugin folder name to match artifactId
- Bump okhttp.version from 4.6.0 to 4.7.2
- Assemble a package ready to be unpacked
- Bump okhttp.version from 4.6.0 to 4.7.0
- First iteration of
PolicyResponseParser
to cope with unexpected http status codes - Implemented
OffsetRecordFilterFactory
to better manage de-duplication - Simplify configuration by providing sensible defaults
PollInterceptor
refactored intoThrottler
- Implemented
FixedIntervalThrottler
with default interval of 10s - Implemented
AdaptableIntervalThrottler
with up-to-date interval of 10s catch-up interval of 1s
- Timestamp offset filtering
- Breaking changes on SPI
HttpRequestFactory
caused by introducingOffset
class in the model
- Support for response item timestamp parsing via DateTimeFormatter with optional TimeZone
- Support for response item timestamp parsing via Natty with optional TimeZone
- Timestamp stored in offset map as an ISO8601 string
- Offset pointer configuration unified into a single property containing a comma separated list of key,value pairs
- Basic OkHttpClient logging enabled
- Support for initial offsets
- Default values for item offsets
- Initial version