Releases: AbsaOSS/py2k
Releases · AbsaOSS/py2k
🐛 Bug fix: Kafka Schema now extracted from entire dataframe
Bug
- 🐛 Kafka Schema was not extracted from entire Dataframe. #76 - @vesely-david
v1.9.0
✨ Added support for dynamic creation from Dataframe to return an iterator. #67 - @vesely-david
- User can choose whether to return list (from_pandas) or iterator (iter_from_pandas)
- KafkaWriter was adjusted accordingly to accept any iterable in it's write method
v1.8.2
Changelog
v1.8.2 (2021-04-06)
Bugs
- Resolved boolean schema not being converted to the correct avro schema values PR #48 - @vesely-david
v1.8.1 (2021-03-31)
Docs
- Added examples and solved mkdocs gitub.io page build - @DanWertheimer. PR #45
v1.8.0 (2021-03-29)
Fixes
- Adhering to Kafka and Avro parlance by renaming:
- models module -> record
- KafkaModel -> KafkaRecord
- DynamicPandasModel -> PandasToRecordsTransformer
- item -> record
- Move schema knowledge to KafkaRecord
- Introduce
__key_fields__
in KafkaRecord to enable specifying which fields are part of the key - Introduce
__include_key__
in KafkaRecord to enable specifying whether key_fields should be part of the value message
Big thank you to @vesely-david for this change
V1.7.0 - First Public Release
Public Go-Live
Our first release of Py2K
features
- Easily post to Kafka with a high-level Python API
- Automatic schema creation from Pydantic-like objects
- Automatic schema creation from pandas DataFrames
- Automatic serialisation of Pydantic-like objects and pandas DataFrames to Avro