forked from celery/kombu
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathChangelog.rst
5238 lines (3434 loc) · 144 KB
/
Changelog.rst
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
.. _changelog:
================
Change history
================
.. _version-5.5.0rc1:
5.5.0rc1
========
:release-date: 14 Oct, 2024
:release-by: Tomer Nosrati
Key Highlights
~~~~~~~~~~~~~~
Native Delayed Delivery
-----------------------
Official support to `RabbitMQ Delayed Delivery <https://docs.particular.net/transports/rabbitmq/delayed-delivery>`_,
which is required to enable ETA tasks with quorum queues in Celery.
urllib3 instead of curl
-----------------------
We can finally say goodbye to the :pypi:`pycurl` dependency and use :pypi:`urllib3` instead.
Transport: Google Pub/Sub
-------------------------
New support for Google Pub/Sub as a transport broker.
What's Changed
~~~~~~~~~~~~~~
- Pin tzdata to latest version 2024.2 (#2121)
- Refactored CI (#2122)
- Added unit tests to "tox -e parallel" environment (#2123)
- Improve pre-commit checks and fix all new lint errors (#2124)
- Removed codecov flags (#2126)
- Pin pre-commit to latest version 3.8.0 (#2125)
- Limit redis-py <5.1.0 (#2132)
- Removed "on push" from the linter GitHub Actions workflow (#2133)
- Bump pymongo from 4.9.1 to 4.10.0 (#2130)
- Update pymongo to 4.10.1 (#2136)
- fix(pytest): skip file-lock test on Windows (#2138)
- Apply errback and callback when retry occurs (#2129)
- Pin pre-commit to latest version 4.0.0 (Python 3.9+) (#2140)
- Pin pre-commit to latest version 4.0.1 (#2144)
- Add native delayed delivery API to kombu (#2128)
- Add support for Google Pub/Sub as transport broker (#2147)
- Update the transport options according to the retry policy (#2148)
- Feature: urllib3 instead of curl (#2134)
- Update mypy to 1.12.0 (#2149)
- Prepare for (pre) release: v5.5.0rc1 (#2150)
.. _version-5.4.2:
5.4.2
=====
:release-date: 19 Sep, 2024
:release-by: Tomer Nosrati
Fixed issue with SQS #2113
- tzdata is required for machines without IANA database (#2107)
- blacksmith.sh: Migrate workflows to Blacksmith (#2112)
- Revert "Validate SQS SSL certs by default" (#2114)
- Update pymongo to 4.9 (#2115)
- Bump pymongo from 4.9 to 4.9.1 (#2118)
- Prepare for release: v5.4.2 (#2119)
.. _version-5.4.1:
5.4.1
=====
:release-date: 11 Sep, 2024
:release-by: Tomer Nosrati
- Update mypy to 1.11.2 (#2101)
- SQS: Fixes #2091 queue_delete() method doesn't actually delete the queue (#2099)
- Validate SQS SSL certs by default (#2094)
- Resolving TypeError, during version unpacking (#2098)
- Revert: allow users to disable broker heartbeats by not providing a timeout (#2097, #2016) (#2104)
- Update msgpack to 1.1.0 (#2105)
- Update pytest to 8.3.3 (#2108)
- Prepare for release: v5.4.1 (#2109)
.. _version-5.4.0:
5.4.0
=====
:release-date: 6 August, 2024
:release-by: Tomer Nosrati
We want to add a special thanks to contribution `#2007 <https://github.com/celery/kombu/pull/2007>`_ by
@awmackowiak for fixing the Redis reconnection bug. Restoring Redis stability has been an essential improvement - thank you!
The rest of the changes are listed below.
Changes
-------
- fix: Fanout exchange messages mixed across virtual databases in Redis sentinel (#1986)
- Pin pymongo to latest version 4.7.2 (#1994)
- enable/fix test_etcd.py (resolves #2001) (#2002)
- Limit requests<2.32.0 due to docker-py issue 3256 (#2011)
- enhance: allow users to disable broker heartbeats (#1998)
- enhance: allow uses to disable broker heartbeats by not providing a timeout (#1997, #1998) (#2016)
- chore(typing): annotate `utils/debug.py` (#1714)
- ConnectionPool can't be used after .resize(..., reset=True) (resolves #2018) (#2024)
- Fix Redis connections after reconnect - consumer starts consuming the tasks after crash (#2007)
- Add support for mongodb+srv scheme (#1976)
- Added Changelog for v5.4.0rc1 (#2033)
- Fixed bumpversion bug with RC versions (#2034)
- Fix typo in README.rst (#2036)
- Reverted limiting requests<2.32.0 in requirements/default.txt but kept in tox.ini due to docker-py issue 3256 (#2041)
- Redis transport - Redelivered messages should respect the original priority (#2026)
- Exclude Unit 3.9 from CI (#2046)
- Fixed CI error from excluding Python 3.9 unit tests (#2047)
- Fixed flaky integration test: test_publish_requeue_consume() (#2048)
- fix: don't crash on `properties`.`body_encoding`: `utf-8` (#1690)
- chore: handle kafka transport with confluentkafka ✨ (#1574)
- Revert "Exclude Unit 3.9 from CI #2046" (#2054)
- fix azure service bus isinstance checks when None (#2053)
- Added Changelog for v5.4.0rc2 (#2056)
- Fixed typo in Changelog for v5.4.0rc2 (#2057)
- Use logging.Logger.warning (#2058)
- SQS: add support for passing MessageAttributes (#2059)
- Added Changelog for v5.4.0rc3 (#2064)
- Prepare for release: v5.4.0 (#2095)
Dependencies Updates
--------------------
- Update mypy to 1.10.0 (#1988)
- Update pytest to 8.2.0 (#1990)
- Bump pytest from 8.2.0 to 8.2.1 (#2005)
- Pin typing_extensions to latest version 4.12.1 (#2017)
- Bump pytest from 8.2.1 to 8.2.2 (#2021)
- Bump pymongo from 4.7.2 to 4.7.3 (#2022)
- Update flake8 to 7.1.0 (#2028)
- Bump mypy from 1.10.0 to 1.10.1 (#2039)
- Bump pymongo from 4.7.3 to 4.8.0 (#2044)
- Pin zstandard to latest version 0.23.0 (#2060)
- Update mypy to 1.11.0 (#2062)
- Update pytest to 8.3.1 (#2063)
- Update typing_extensions to 4.12.2 (#2066)
- Pin vine to latest version 5.1.0 (#2067)
- Update pytest to 8.3.2 (#2076)
- Pin codecov to latest version 2.1.13 (#2084)
- Pin pytest-freezer to latest version 0.4.8 (#2085)
- Pin msgpack to latest version 1.0.8 (#2080)
- Pin python-consul2 to latest version 0.1.5 (#2078)
- Pin pycouchdb to latest version 1.16.0 (#2079)
- Pin bumpversion to latest version 0.6.0 (#2083)
- Pin kazoo to latest version 2.10.0 (#2082)
- Pin pyro4 to latest version 4.82 (#2081)
- Bump mypy from 1.11.0 to 1.11.1 (#2087)
- Bump flake8 from 7.1.0 to 7.1.1 (#2090)
Changes since 5.4.0rc3
----------------------
- Update typing_extensions to 4.12.2 (#2066)
- Pin vine to latest version 5.1.0 (#2067)
- Update pytest to 8.3.2 (#2076)
- Pin codecov to latest version 2.1.13 (#2084)
- Pin pytest-freezer to latest version 0.4.8 (#2085)
- Pin msgpack to latest version 1.0.8 (#2080)
- Pin python-consul2 to latest version 0.1.5 (#2078)
- Pin pycouchdb to latest version 1.16.0 (#2079)
- Pin bumpversion to latest version 0.6.0 (#2083)
- Pin kazoo to latest version 2.10.0 (#2082)
- Pin pyro4 to latest version 4.82 (#2081)
- Bump mypy from 1.11.0 to 1.11.1 (#2087)
- Bump flake8 from 7.1.0 to 7.1.1 (#2090)
- Prepare for release: v5.4.0 (#2095)
.. _version-5.4.0rc3:
5.4.0rc3
========
:release-date: 22 July, 2024
:release-by: Tomer Nosrati
- Fixed typo in Changelog for v5.4.0rc2 (#2057)
- Use logging.Logger.warning (#2058)
- Pin zstandard to latest version 0.23.0 (#2060)
- Update mypy to 1.11.0 (#2062)
- Update pytest to 8.3.1 (#2063)
- SQS: add support for passing MessageAttributes (#2059)
.. _version-5.4.0rc2:
5.4.0rc2
========
:release-date: 11 July, 2024
:release-by: Tomer Nosrati
The ``requests`` package is no longer limited to <2.32.0 per #2041.
Contribution #2007 by @awmackowiak was confirmed to have solved the Redis reconnection bug.
- Bump mypy from 1.10.0 to 1.10.1 (#2039)
- Fix typo in README.rst (#2036)
- Reverted limiting requests<2.32.0 in requirements/default.txt but kept in tox.ini due to docker-py issue 3256 (#2041)
- Redis transport - Redelivered messages should respect the original priority (#2026)
- Exclude Unit 3.9 from CI (#2046)
- Fixed CI error from excluding Python 3.9 unit tests (#2047)
- Fixed flaky integration test: test_publish_requeue_consume() (#2048)
- Bump pymongo from 4.7.3 to 4.8.0 (#2044)
- fix: don't crash on `properties`.`body_encoding`: `utf-8` (#1690)
- chore: handle kafka transport with confluentkafka ✨ (#1574)
- Revert "Exclude Unit 3.9 from CI #2046" (#2054)
- fix azure service bus isinstance checks when None (#2053)
.. _version-5.4.0rc1:
5.4.0rc1
========
:release-date: 22 June, 2024
:release-by: Tomer Nosrati
We want to add a special thanks to contribution #2007 by @awmackowiak for fixing the Redis reconnection bug.
This release candidate aims to allow the community to test the changes and provide feedback.
Please let us know if Redis is stable again!
New: #1998, #2016, #2024, #1976
The rest of the changes are bug fixes and dependency updates.
Lastly, ``requests`` is limited to <2.32.0 per #2011.
- Update mypy to 1.10.0 (#1988)
- Update pytest to 8.2.0 (#1990)
- fix: Fanout exchange messages mixed across virtual databases in Redis sentinel (#1986)
- Pin pymongo to latest version 4.7.2 (#1994)
- enable/fix test_etcd.py (resolves #2001) (#2002)
- Bump pytest from 8.2.0 to 8.2.1 (#2005)
- Limit requests<2.32.0 due to docker-py issue 3256 (#2011)
- enhance: allow users to disable broker heartbeats (#1998)
- enhance: allow uses to disable broker heartbeats by not providing a timeout (#1997,#1998) (#2016)
- Pin typing_extensions to latest version 4.12.1 (#2017)
- chore(typing): annotate `utils/debug.py` (#1714)
- Bump pytest from 8.2.1 to 8.2.2 (#2021)
- Bump pymongo from 4.7.2 to 4.7.3 (#2022)
- ConnectionPool can't be used after .resize(..., reset=True) (resolves #2018) (#2024)
- Fix Redis connections after reconnect - consumer starts consuming the tasks after crash. (#2007)
- Update flake8 to 7.1.0 (#2028)
- Add support for mongodb+srv scheme (#1976)
.. _version-5.3.7:
5.3.7
=====
:release-date: 11 April, 2024
:release-by: Tomer Nosrati
The release of v5.3.6 was missing the bumbversion commit so v5.3.7 is only released to sync it back.
.. _version-5.3.6:
5.3.6
=====
:release-date: 27 Mar, 2024
:release-by: Tomer Nosrati
- boto3>=1.26.143 (#1890)
- Always convert azureservicebus namespace to fully qualified (#1892)
- Pin pytest-sugar to latest version 1.0.0 (#1912)
- Upgrade to pytest v8 that removed nose compatibility (#1914)
- fix warning for usage of utcfromtimestamp (#1926)
- Update pytest to 8.0.2 (#1942)
- Hotfix: Fix CI failures (limit redis to <5.0.2 instead of <6.0.0) (#1961)
- Expose cancel callback from py-amqp channel.basic_consume (#1953)
- Update mypy to 1.9.0 (#1963)
- Update pytest to 8.1.1 (#1965)
- Pin hypothesis to hypothesis<7 (#1966)
- redis>=4.5.2,<5.0.2,!=4.5.5 -> redis>=4.5.2,!=5.0.2,!=4.5.5 (#1969)
- add escape hatch for custom JSON serialization (#1955)
- Pin pytest-cov to latest version 5.0.0 (#1972)
.. _version-5.3.5:
5.3.5
=====
:release-date: 12 Jan, 2024
:release-by: Tomer Nosrati
- Fix ReadTheDocs CI (#1827).
- fix(docs): add Redis to the list of transports where SSL is supported (#1826).
- Fixed Improper Method Call: Replaced `mktemp` (#1828).
- Bump actions/setup-python from 4 to 5 (#1829).
- Bump github/codeql-action from 2 to 3 (#1832).
- fix: freeze set during ticks iter in async hub (#1830).
- azure service bus: fix TypeError when using Managed Identities (#1825).
- Fix unacknowledge typo in restore_visible() (#1839).
- Changed pyup -> dependabot for updating dependencies (#1842).
- Bump pytest from 7.4.3 to 7.4.4 (#1843).
- Bump flake8 from 6.0.0 to 7.0.0 (#1845).
- Bump mypy from 1.3.0 to 1.8.0 (#1844).
- Fix crash when using global_keyprefix with a sentinel connection (#1838)
- Fixed version_dev in docs/conf.py (#1875).
.. _version-5.3.4:
5.3.4
=====
:release-date: 16 Nov, 2023
:release-by: Asif Saif Uddin
- Use the correct protocol for SQS requests (#1807).
.. _version-5.3.3:
5.3.3
=====
:release-date: 6 Nov, 2023
:release-by: Asif Saif Uddin
- Raise access denied error when ack.
- test redis 5.0.0.
- fix azure servicebus using managed identity support (#1801).
- Added as_uri method to MongoDB transport - Fixes #1795 (#1796).
- Revert "[fix #1726] Use boto3 for SQS async requests (#1759)" (#1799).
- Create a lock on cached_property if not present (#1811).
- Bump kafka deps versions & fix integration test failures (#1818).
- Added Python 3.12 support.
- Fix: redis requeue concurrency bug #1800 (#1805).
.. _version-5.3.2:
5.3.2
=====
:release-date: 31 Aug, 2023
:release-by: Tomer Nosrati
- Reverted unwanted constraint introduced in #1629 with max_retries (#1755)
- Doc fix (hotfix for #1755) (#1758)
- Python3.12: fix imports in kombu/utils/objects.py (#1756)
- [fix #1726] Use boto3 for SQS async requests (#1759)
- docs: Remove SimpleQueue import (#1764)
- Fixed pre-commit issues (#1773)
- azure service bus: add managed identity support (#1641)
- fix: Prevent redis task loss when closing connection while in poll (#1733)
- Kombu & celery with SQS #222 (#1779)
- syntax correction (#1780)
.. _version-5.3.1:
5.3.1
=====
:release-date: 15 Jun, 2023
:release-by: Asif Saif Uddin
- Update pycurl version.
- Declare python 3.11 support (#1425).
- Fix: allow deserializing any version of UUID.
- Update PyCurl version in SQS (#1747).
.. _version-5.3.0:
5.3.0
=====
:release-date: 03 Jun, 2023
:release-by: Asif Saif Uddin
- Support for Kafka as transport.
- Add fanout to filesystem (#1499).
- Added possibility to serialize and deserialize binary messages in json (#1516).
- Support pymongo 4.x (#1536).
- Support redis-py 4.5.x.
- Upgrade Azure Storage Queues transport to version 12 (#1539).
- Add support to SQS DelaySeconds (#1567).
- Add WATCH to prefixed complex commands.
- Avoid losing type of UUID when serializing/deserializing (#1575).
- Added HLEN to the list of prefixed redis commands (#1540).
- Add managed identity support to azure storage queue (#1631).
- Add Support of sqlalchemy v2.0.
- Deprecate pytz and use zoneinfo (#1680)
.. _version-5.3.0rc2:
5.3.0rc2
========
:release-date: 31 May, 2023
:release-by: Asif Saif Uddin
- add missing zoneinfo dependency (#1732).
- Support redis >= 4.5.2
- Loosen urlib3 version range for botocore compat
.. _version-5.3.0rc1:
5.3.0rc1
========
:release-date: 24 May, 2023
:release-by: Asif Saif Uddin
- Moved to pytest-freezer (#1683).
- Deprecate pytz and use zoneinfo (#1680).
- handle keyerror in azureservicebus transport when message is not
found in qos and perform basic_ack (#1691).
- fix mongodb transport obsolete calls (#1694).
- SQS: avoid excessive GetQueueURL calls by using cached queue url (#1621).
- Update confluentkafka.txt version (#1727).
- Revert back to pyro4 for now.
.. _version-5.3.0b3:
5.3.0b3
=======
:release-date: 20 Mar, 2023
:release-by: Asif Saif Uddin
- Use SPDX license expression in project metadata.
- Allowing Connection.ensure() to retry on specific exceptions given by policy (#1629).
- Redis==4.3.4 temporarilly in an attempt to avoid BC (#1634).
- Add managed identity support to azure storage queue (#1631).
- Support sqla v2.0 (#1651).
- Switch to Pyro5 (#1655).
- Remove unused _setupfuns from serialization.py.
- Refactor: Refactor utils/json (#1659).
- Adapt the mock to correctly mock the behaviors as implemented on Python 3.10. (Ref #1663).
.. _version-5.3.0b2:
5.3.0b2
=======
:release-date: 19 Oct, 2022
:release-by: Asif Saif Uddin
- fix: save QueueProperties to _queue_name_cache instead of QueueClient.
- hub: tick delay fix (#1587).
- Fix incompatibility with redis in disconnect() (#1589).
- Solve Kombu filesystem transport not thread safe.
- importlib_metadata remove deprecated entry point interfaces (#1601).
- Allow azurestoragequeues transport to be used with Azurite emulator in docker-compose (#1611).
.. _version-5.3.0b1:
5.3.0b1
=======
:release-date: 1 Aug, 2022
:release-by: Asif Saif Uddin
- Add ext.py files to setup.cfg.
- Add support to SQS DelaySeconds (#1567).
- Add WATCH to prefixed complex commands.
- Avoid losing type of UUID when serializing/deserializing (#1575).
- chore: add confluentkafka to extras.
.. _version-5.3.0a1:
5.3.0a1
=======
:release-date: 29 Jun, 2022
:release-by: Asif Saif Uddin
- Add fanout to filesystem (#1499).
- Protect set of ready tasks by lock to avoid concurrent updates. (#1489).
- Correct documentation stating kombu uses pickle protocol version 2.
- Use new entry_points interface.
- Add mypy to the pipeline (#1512).
- Added possibility to serialize and deserialize binary messages in json (#1516).
- Bump pyupgrade version and add __future__.annotations import.
- json.py cleaning from outdated libs (#1533).
- bump new py-amqp to 5.1.1 (#1534).
- add GitHub URL for PyPi.
- Upgrade pytest to ~=7.1.1.
- Support pymongo 4.x (#1536).
- Initial Kafka support (#1506).
- Upgrade Azure Storage Queues transport to version 12 (#1539).
- move to consul2 (#1544).
- Datetime serialization and deserialization fixed (#1515).
- Bump redis>=4.2.2 (#1546).
- Update sqs dependencies (#1547).
- Added HLEN to the list of prefixed redis commands (#1540).
- Added some type annotations.
.. _version-5.2.4:
5.2.4
=====
:release-date: 06 Mar, 2022
:release-by: Asif Saif Uddin
- Allow getting recoverable_connection_errors without an active transport.
- Prevent KeyError: 'purelib' by removing INSTALLED_SCHEME hack from setup.py.
- Revert "try pining setuptools (#1466)" (#1481).
- Fix issue #789: Async http code not allowing for proxy config (#790).
- Fix The incorrect times of retrying.
- Set redelivered property for Celery with Redis (#1484).
- Remove use of OrderedDict in various places (#1483).
- Warn about missing hostname only when default one is available (#1488).
- All supported versions of Python define __package__.
- Added global_keyprefix support for pubsub clients (#1495).
- try pytest 7 (#1497).
- Add an option to not base64-encode SQS messages.
- Fix SQS extract_task_name message reference.
.. _version-5.2.3:
5.2.3
=====
:release-date: 29 Dec, 2021
:release-by: Asif Saif Uddin
- Allow redis >= 4.0.2.
- Fix PyPy CI jobs.
- SQS transport: detect FIFO queue properly by checking queue URL (#1450).
- Ensure that restore is atomic in redis transport (#1444).
- Restrict setuptools>=59.1.1,<59.7.0.
- Bump minimum py-amqp to v5.0.9 (#1462).
- Reduce memory usage of Transport (#1470).
- Prevent event loop polling on closed redis transports (and causing leak).
- Respect connection timeout (#1458)
- prevent redis event loop stopping on 'consumer: Cannot connect' (#1477).
.. _version-5.2.2:
5.2.2
=====
:release-date: 16 Nov, 2021
:release-by: Asif Saif Uddin
- Pin redis version to >= 3.4.1<4.0.0 as it is not fully compatible yet.
.. _version-5.2.1:
5.2.1
=====
:release-date: 8 Nov, 2021
:release-by: Asif Saif Uddin
- Bump redis version to >= 3.4.1.
- try latest sqs dependencies ti fix security warning.
- Tests & dependency updates
.. _version-5.2.0:
5.2.0
=====
:release-date: 5 Nov, 2021
:release-by: Naomi Elstein
- v 1.4.x (#1338).
- stop mentioning librabbitmq (#1381).
- Merge branch 'master' of https://github.com/celery/kombu
- test new pytest version (#1383).
- drop python 3.6 from CI (#1382).
- Use ANY from unittest instead of case.mock.
- Fix missing dependency to redis in docs requirements.
- [pre-commit.ci] pre-commit autoupdate.
- Remove dependency to case (#1389).
- Fix: check redis response type.
- [pre-commit.ci] pre-commit autoupdate (#1393).
- py3.7+ on setup (#1392).
- Prevent caching of oid in pidbox (#1394).
- Added unittests for #1394 .
- fix flake8 in kombu/asynchronous/aws/connection.py (#1397).
- [pre-commit.ci] pre-commit autoupdate.
- Fix test_pidbox unittests to support non-linux platforms (#1398).
- [pre-commit.ci] pre-commit autoupdate.
- removre bdist.
- add python 3.10 to CI & fix other issues (#1402).
- try to fix CI (#1407).
- Dont failfast when pypy3 tests fail (#1408).
- Return empty list instead of InconsistencyError when exchange table is empty (#1404).
- [pre-commit.ci] pre-commit autoupdate.
.. _version-5.2.0rc1:
5.2.0rc1
========
:release-date: 2021-09-07 7:00 P.M UTC+6:00
:release-by: Asif Saif Uddin
- Remove backward compatible code not used anymore (#1344).
- Add support for setting redis username (#1351).
- Add support for Python 3.9.
- Use hostname from URI when server_host is None.
- Use Python's built-in json module by default, instead of simplejson.
- SQS Channel.predefined_queues should be {} if not defined.
- Add global key prefix for keys set by Redis transporter (#1349).
- fix: raise BrokenPipeError (#1231).
- fix: add missing commands to prefix.
- Make BrokerState Transport specific.
- Tests & Docs cleanup.
.. _version-5.1.0:
5.1.0
=====
:release-date: 2021-05-23 7:00 P.M UTC+3:00
:release-by: Omer Katz
- Fix queue names special characters replacement for Azure Service Bus. (#1324)
- Add support for SQLAlchemy 1.4. (#1328)
- Coerce seconds argument to a floating point number in ``Timer.enter_after``. (#1330)
- Add accept parameter to SimpleQueue class. (#1140)
- ``prepare_accept_content()`` now raises ``SerializerNotInstalled`` instead of ``KeyError``. (#1343)
.. _version-5.1.0b1:
5.1.0b1
=======
:release-date: 2021-04-01 10:30 P.M UTC+6:00
:release-by: Asiff Saif Uddin
- Wheels are no longer universal.
- Revert "Added redis transport key_prefix from envvars".
- Redis Transport: Small improvements of `SentinelChannel` (#1253).
- Fix pidbox not using default channels.
- Revert "on worker restart - restore visible regardless to time (#905)".
- Add vine to dependencies.
- Pin urllib3<1.26 to fix failing unittests.
- Add timeout to producer publish (#1269).
- Remove python2 compatibility code (#1277).
- redis: Support Sentinel with SSL.
- Support for Azure Service Bus 7.0.0 (#1284).
- Allow specifying session token (#1283).
- kombu/asynchronous/http/curl: implement _set_timeout.
- Disable namedtuple to object feature in simplejson (#1297).
- Update to tox docker 2.0.
- SQS back-off policy (#1301).
- Fixed SQS unittests.
- Fix: non kombu json message decoding in SQS transport (#1306).
- Add Github Actions CI (#1309).
- Update default pickle protocol version to 4 (#1314).
- Update connection.py (#1311).
- Drop support for the lzma backport.
- Drop obsolete code importing pickle (#1315).
- Update default login method for librabbitmq and pyamqp (#936).
- SQS Broker - handle STS authentication with AWS (#1322).
- Min py-amqp version is v5.0.6 (#1325).
- Numerous docs & example fixes.
- Use a thread-safe implementation of cached_property (#1316).
.. _version-5.0.2:
5.0.2
=====
:release-date: 2020-09-06 6:30 P.M UTC+3:00
:release-by: Omer Katz
- Bump required amqp version to 5.0.0.
.. _version-5.0.1:
5.0.1
=====
:release-date: 2020-08-23 19:10 P.M UTC+3:00
:release-by: Omer Katz
- Removed kombu.five from the reference documentation since it no longer exists
- Adjusted the stable documentation's version in Sphinx's configuration since that was overlooked in the latest release
.. _version-5.0.0:
5.0.0
=====
:release-date: 2020-08-05 16:00 P.M UTC+3:00
:release-by: Omer Katz
- **BREAKING CHANGE**: Dropped support for Python 2 (#1232)
- Add an SQS transport option for custom botocore config (#1219)
.. _version-4.6.11:
4.6.11
=======
:release-date: 2020-06-24 1.15 P.M UTC+6:00
:release-by: Asif Saif Uddin
- Revert incompatible changes in #1193 and additional improvements (#1211)
- Default_channel should reconnect automatically (#1209)
.. _version-4.6.10:
4.6.10
======
:release-date: 2020-06-03 10.45 A.M UTC+6:00
:release-by: Asif Saif Uddin
- Doc improvement.
- set _connection in _ensure_connection (#1205)
- Fix for the issue #1172
- reuse connection [bug fix]
.. _version-4.6.9:
4.6.9
=====
:release-date: 2020-06-01 14.00 P.M UTC+6:00
:release-by: Asif Saif Uddin
- Prevent failure if AWS creds are not explicitly defined on predefined.
- Raise RecoverableConnectionError in maybe_declare with retry on and.
- Fix for the issue #1172 .
- possible fix for #1174 .
- Fix: make SQLAlchemy Channel init thread-safe
- Added integration testing infrastructure for RabbitMQ
- Initial redis integration tests implementation
- SQLAlchemy transport: Use Query.with_for_update() instead of deprecated
- Fix Consumer Encoding
- Added Integration tests for direct, topic and fanout exchange types
- Added TTL integration tests
- Added integration tests for priority queues
- fix 100% cpu usage on linux while using sqs
- Modified Mutex to use redis LuaLock implementation
- Fix: eliminate remaining race conditions from SQLAlchemy Channel
- Fix connection imaybe_declare (#1196)
- Fix for issue #1198: Celery crashes in cases where there aren’t enough
- Ensure connection when connecting to broker
- update pyamqp to 2.6 with optional cythonization
.. _version-4.6.8:
4.6.8
=====
:release-date: 2020-03-29 20:45 A.M UTC+6:00
:release-by: Asif Saif Uddin
- Added support for health_check_interval option in broker_transport_options (#1145)
- Added retry_on_timeout parameter to Redis Channel (#1150)
- Added support for standard values for ssl_cert_reqs query parameter for Redis (#1139)
- Added predefined_queues option to SQS transport (#1156)
- Added ssl certificate verification against ca certificates when amqps is used for pyamqp transport (#1151)
- Fix issue (#701) where kombu.transport.redis.Mutex is broken in python 3 (#1141)
- Fix brop error in Redis Channel (#1144)
.. _version-4.6.7:
4.6.7
=====
:release-date: 2019-12-07 20:45 A.M UTC+6:00
:release-by: Asif Saif Uddin
- Use importlib.metadata from the standard library on Python 3.8+ (#1086).
- Add peek lock settings to be changed using transport options (#1119).
- Fix redis health checks (#1122).
- Reset ready before execute callback (#1126).
- Add missing parameter queue_args in kombu.connection.SimpleBuffer (#1128)
.. _version-4.6.6:
4.6.6
=====
:release-date: 2019-11-11 00:15 A.M UTC+6:00
:release-by: Asif Saif Uddin
- Revert _lookup_direct and related changes of redis.
- Python 3.8 support
- Fix 'NoneType' object has no attribute 'can_read' bug of redis transport
- Issue #1019 Fix redis transport socket timeout
- Add wait timeout settings to receive queue message (#1110)
- Bump py-amqp to 2.5.2
.. _version-4.6.5:
4.6.5
=====
:release-date: 2019-09-30 19:30 P.M UTC+6:00
:release-by: Asif Saif Uddin
- Revert _lookup api and correct redis implemetnation.
- Major overhaul of redis test cases by adding more full featured fakeredis module.
- Add more test cases to boost coverage of kombu redis transport.
- Refactor the producer consumer test cases to be based on original mocks and be passing
- Fix lingering line length issue in test.
- Sanitise url when include_password is false
- Pinned pycurl to 7.43.0.2 as it is the latest build with wheels provided
- Bump py-amqp to 2.5.2
.. _version-4.6.4:
4.6.4
=====
:release-date: 2019-08-14 22:45 P.M UTC+6:00
:release-by: Asif Saif Uddin
- Use importlib-metadata instead of pkg_resources for better performance
- Allow users to switch URLs while omitting the resource identifier (#1032)
- Don't stop receiving tasks on 503 SQS error. (#1064)
- Fix maybe declare (#1066)
- Revert "Revert "Use SIMEMBERS instead of SMEMBERS to check for queue (Redis Broker)
- Fix MongoDB backend to work properly with TTL (#1076)
- Make sure that max_retries=0 is treated differently than None (#1080)
- Bump py-amqp to 2.5.1
.. _version-4.6.3:
4.6.3
=====
:release-date: 2019-06-15 12:45 A.M UTC+6:00
:release-by: Asif Saif Uddin
- Revert FastUUID for kombu 4.6
.. _version-4.6.2:
4.6.2
=====
:release-date: 2019-06-15 12:45 A.M UTC+6:00
:release-by: Asif Saif Uddin
- Fix sbugs and regressions
.. _version-4.6.1:
4.6.1
=====
:release-date: 2019-06-06 10:30 A.M UTC+6:00
:release-by: Asif Saif Uddin
- Fix some newly introduced bug in kombu 4.6
.. _version-4.6.0:
4.6.0
=====
:release-date: 2019-05-30 15:30 P.M UTC+6:00
:release-by: Asif Saif Uddin
- Dropped python 3.4
- Bump py-amqp to 2.5.0
- Use SIMEMBERS instead of SMEMBERS to check for queue (redis broker)
* Add `_lookup_direct` method to virtual channel. (#994)
Add possibility to optimize lookup for queue in direct
exchange set.
* Add `_lookup_direct` method to redis virtual channel. (#994)
Use `SISMEMBER` instead of `SMEMBERS` command to check if queue
exists in a set. Time complexity is increased from O(N) to O(1)
where N is the set cardinality.
Contributed by **Stevan Milic** and **Asif Saif Uddin**
- Include priority in properties only if it's not None.
Since we attempt to serialize the priority property if it exists
in the dictionary it must be an integer.
Contributed by **Omer Katz**
- Removed dangerous default mutable arguments from function
definitions where appropriate.
Contributed by **Todd Cook**
- Codebase improvements and fixes by:
- **Omer Katz**
- **Asif Saif Uddin**
.. _version-4.5.0:
4.5.0
=====
:release-date: 2019-03-3 18:30 P.M UTC+3:00
:release-by: Omer Katz
- The Redis transport now supports a custom separator for keys.
Previously when storing a key in Redis which represents a queue
we used the hardcored value ``\x06\x16`` separator to store
different attributes of the queue in the queue's name.
The separator is now configurable using the sep
transport option:
.. code-block:: python
with Connection('redis://', transport_options={
'sep': ':',
}):
# ...
pass
Contributed by **Joris Beckers**
- When the SQS server returns a timeout we ignore it and keep trying
instead of raising an error.
This will prevent Celery from raising an error and hanging.
Contributed by **Erwin Rossen**
- Properly declare async support for the Qpid transport.
If you are using this transport we strongly urge you to upgrade.
Contributed by **Rohan McGovern**
- Revert `celery/kombu#906 <https://github.com/celery/kombu/pull/906>`_ and
introduce unique broadcast queue names as an optional keyword argument.
If you want each broadcast queue to have a unique name specify `unique=True`:
.. code-block:: pycon
>>> from kombu.common import Broadcast
>>> q = Broadcast(queue='foo', unique=True)
>>> q.name
'foo.7ee1ac20-cda3-4966-aaf8-e7a3bb548688'
>>> q = Broadcast(queue='foo')
>>> q.name
'foo'
- Codebase improvements and fixes by:
- **Omer Katz**
.. _version-4.4.0:
4.4.0
=====
:release-date: 2019-03-3 9:00 P.M UTC+2:00
:release-by: Omer Katz
- Restore bz2 import checks in compression module.
The checks were removed in `celery/kombu#938 <https://github.com/celery/kombu/pull/938>`_ due to assumption that it only affected Jython.
However, bz2 support can be missing in Pythons built without bz2 support.
Contributed by **Patrick Woods**
- Fix regression that occurred in 4.3.0
when parsing Redis Sentinel master URI containing password.
Contributed by **Peter Lithammer**
- Handle the case when only one Redis Sentinel node is provided.
Contributed by **Peter Lithammer**
- Support SSL URL parameters correctly for `rediss://`` URIs.
Contributed by **Paul Bailey**
- Revert `celery/kombu#954 <https://github.com/celery/kombu/pull/954>`_.
Instead bump the required redis-py dependency to 3.2.0
to include this fix `andymccurdy/redis-py@4e1e748 <https://github.com/andymccurdy/redis-py/commit/4e1e74809235edc19e03edb79c97c80a3e4e9eca>`_.
Contributed by **Peter Lithammer**
- Added support for broadcasting using a regular expression pattern
or a glob pattern to multiple Pidboxes.
Contributed by **Jason Held**
.. _version-4.3.0:
4.3.0
=====
:release-date: 2019-01-14 7:00 P.M UTC+2:00
:release-by: Omer Katz
- Added Python 3.7 support.
Contributed by **Omer Katz**, **Mads Jensen** and **Asif Saif Uddin**
- Avoid caching queues which are declared with a TTL.
Queues that are declared with a TTL are now also be excluded from the
in-memory cache in case they expire between publishes on the same channel.
Contributed by **Matt Yule-Bennett**
- Added an index to the Message table for the SQLAlchemy transport.
The index allows to effectively sorting the table by the message's timestamp.
.. note::
We do not provide migrations for this model yet.
You will need to add the index manually if you are already
using the SQLAlchemy transport.