CHANGELOG.md

Changelog

12.2.0 (2024-03-28)

Features

• api: introduce mempool cache (#1460) (c5d6c4b)
• commitment-generator: events_queue shadow mode (#1138) (9bb47fa)
• Drop prover tables in core database (#1436) (0d78122)
• Follow-up for DAL split (#1464) (c072288)
• prover: export prover traces through OTLP (#1427) (16dce75)
• prover: File-info tool to help prover debugging (#1216) (9759907)
• Separate Prover and Server DAL (#1334) (103a56b)
• support running consensus from snapshot (BFT-418) (#1429) (f9f4d38)

Bug Fixes

• api: Fix API server shutdown flow (#1425) (780f6b0)
• prover: Remove FriProtocolVersionId (#1510) (6aa51b0)

12.1.0 (2024-03-12)

Features

• add run-observability to zk (#1359) (2b520f6)
• block revert support for consensus component (#1213) (8a3a938)
• enhance unit test for batch tip (#1253) (ca7d194)
• Moving 1.4.x to use the circuit_api (#1383) (8add2d6)
• prover: Fixing snark verification keys (#1225) (5cbef73)
• replacing 1.3.3 test harness with circuit sequencer api (#1382) (a628d56)
• Start using a new test harness interface without generics (#1378) (1e431a6)

Bug Fixes

• api: SQL: use = instead of ANY where possible in events-related queries (#1346) (160b4d4)
• Updated Verification keys (#1414) (66667d2)

12.0.1 (2024-03-05)

Performance Improvements

• remove CSReferenceAssembly structure instantiation in GPU prover (#1100) (5c405ba)

12.0.0 (2024-03-04)

⚠ BREAKING CHANGES

• prover: Add EIP4844 support for provers subsystem (#1200)
• Set 21 as latest protocol version (#1262)

Features

• Adding ability to generate 4844 setup key and refactor (#1143) (975f54b)
• api: Remove unused and obsolete token info (#1071) (e920897)
• dal: zksync_types::Transaction to use protobuf for wire encoding (BFT-407) (#1047) (ee94bee)
• db: Soft-remove storage table (#982) (601f893)
• en: Integrate snapshots recovery into EN (#1032) (c7cfaf9)
• healthcheck: Various healthcheck improvements (#1166) (1e34148)
• improving verification key generation (#1050) (6f715c8)
• Prover interface and L1 interface crates (#959) (4f7e107)
• prover: Add EIP4844 support for provers subsystem (#1200) (6953e89)
• prover: Added --recompute-if-missing option to key generator (#1151) (cad7278)
• prover: Added 4844 circuit to verification keys (#1141) (8b0cc4a)
• prover: Adding first support for 4844 circuit (#1155) (6f63c53)
• prover: adding keystore object to handle reading and writing of prover keys (#1132) (1471615)
• prover: merging key generation into a single binary (#1101) (6de8b84)
• prover: Moved setup key generation logic to test harness (#1113) (469ab06)
• prover: Use new shivini function for 4844 circuits (#1205) (376c09e)
• Set 21 as latest protocol version (#1262) (30579ef)
• vlog: Remove env getters from vlog (#1077) (00d3429)

Bug Fixes

• fix link (#1007) (f1424ce)
• make zk status prover use the new prover table (#1044) (9b21d7f)
• prover: Decouple core/ prover database management (#1029) (37674fd)
• prover: Fix initial prover migration (#1083) (6d54010)
• prover: QoL socket utilization (#1020) (13a6816)
• update harness to include fix to new boojum OOM (#1053) (4976941)

Performance Improvements

• bump harness version (#1003) (1cbb4c9)
• reduce memory consumption of witness generation (#696) (dea6768)
• upgrade harness version to improve witness generation memory spike (#1034) (09bbb84)
• use jemalloc in witness generator (#1014) (917b2dc)

11.0.0 (2024-01-29)

⚠ BREAKING CHANGES

• vm: fee model updates + 1.4.1 (#791)

Features

• api: Make Web3 API server work with pruned data (#838) (0b7cd0b)
• consensus component config for main node and external node (#881) (1aed8de)
• en: Restore state keeper storage from snapshot (#885) (a9553b5)
• fee model updates + 1.4.1 stage upgrade (#897) (fa48c13)
• protobuf-generated json configs for the main node (BFT-371) (#458) (f938314)
• Remove zkevm_test_harness public reexport from zksync_types (#929) (dd1a35e)
• state-keeper: circuits seal criterion (#729) (c4a86bb)
• vm: fee model updates + 1.4.1 (#791) (3564aff)

Bug Fixes

• address issue with spellchecker not checking against prover workspace (#855) (4f55926)
• addresses broken links in preparation for ci link check (#869) (a78d03c)
• prover: Update shivini (#915) (f141a00)
• witness-generator: Update era-zkevm_test_harness (#912) (c03c2e3)
• witness-generator: Update zkevm_test_harness (#930) (16fdcff)

10.1.0 (2024-01-05)

Features

• prover: Remove circuit-synthesizer (#801) (1426b1b)
• prover: Remove old prover (#810) (8be1925)

Bug Fixes

• prover: increase DB polling interval for witness vector generators (#697) (94579cc)
• prover: Remove prover-utils from core (#819) (2ceb911)

10.0.2 (2023-12-21)

Bug Fixes

• prover: Reduce amount of prover connections per prover subcomponent (#734) (d38aa85)

10.0.1 (2023-12-21)

Bug Fixes

• prover: Add logging for prover + WVGs (#723) (d7ce14c)
• prover: update rescue_poseidon version (#726) (3db25cb)

10.0.0 (2023-12-05)

⚠ BREAKING CHANGES

• boojum integration (#112)
• Update to protocol version 17 (#384)

Features

• Add various metrics to the Prover subsystems (#541) (58a4e6c)
• adds spellchecker workflow, and corrects misspelled words (#559) (beac0a8)
• boojum integration (#112) (e76d346)
• boojum: Adding README to prover directory (#189) (c175033)
• config: Extract everything not related to the env config from zksync_config crate (#245) (42c64e9)
• core: Split config definitions and deserialization (#414) (c7c6b32)
• dal: Do not load config from env in DAL crate (#444) (3fe1bb2)
• en: Implement gossip fetcher (#371) (a49b61d)
• fri-prover: In witness - panic if protocol version is not available (#192) (0403749)
• hyperchain: Adding prover related commands to zk stack (#440) (580cada)
• job-processor: report attempts metrics (#448) (ab31f03)
• merkle tree: Allow random-order tree recovery (#485) (146e4cf)
• merkle tree: Snapshot recovery for Merkle tree (#163) (9e20703)
• Rewrite server binary to use vise metrics (#120) (26ee1fb)
• Update to protocol version 17 (#384) (ba271a5)
• vm: Move all vm versions to the one crate (#249) (e3fb489)
• witness-generator: add logs to leaf aggregation job (#542) (7e95a3a)

Bug Fixes

• Change no pending batches 404 error into a success response (#279) (e8fd805)
• ci: Use the same nightly rust (#530) (67ef133)
• crypto: update deps to include circuit fixes (#402) (4c82015)
• crypto: update shivini to switch to era-cuda (#469) (38bb482)
• crypto: update snark-vk to be used in server and update args for proof wrapping (#240) (4a5c54c)
• docs: Add links to setup-data keys (#360) (1d4fe69)
• path: update gpu prover setup data path to remove extra gpu suffix (#454) (2e145c1)
• prover-fri: Update setup loading for node agg circuit (#323) (d1034b0)
• prover-logging: tasks_allowed_to_finish set to true for 1 off jobs (#227) (0fac66f)
• Sync protocol version between consensus and server blocks (#568) (56776f9)
• Update prover to use the correct storage oracle (#446) (835dd82)

9.1.0 (2023-12-05)

Features

• Add various metrics to the Prover subsystems (#541) (58a4e6c)
• adds spellchecker workflow, and corrects misspelled words (#559) (beac0a8)
• dal: Do not load config from env in DAL crate (#444) (3fe1bb2)
• en: Implement gossip fetcher (#371) (a49b61d)
• hyperchain: Adding prover related commands to zk stack (#440) (580cada)
• job-processor: report attempts metrics (#448) (ab31f03)
• merkle tree: Allow random-order tree recovery (#485) (146e4cf)
• witness-generator: add logs to leaf aggregation job (#542) (7e95a3a)

Bug Fixes

• Change no pending batches 404 error into a success response (#279) (e8fd805)
• ci: Use the same nightly rust (#530) (67ef133)
• crypto: update shivini to switch to era-cuda (#469) (38bb482)
• Sync protocol version between consensus and server blocks (#568) (56776f9)

9.0.0 (2023-11-09)

⚠ BREAKING CHANGES

• boojum integration (#112)

Features

• boojum integration (#112) (e76d346)
• core: Split config definitions and deserialization (#414) (c7c6b32)

Bug Fixes

• crypto: update deps to include circuit fixes (#402) (4c82015)
• path: update gpu prover setup data path to remove extra gpu suffix (#454) (2e145c1)
• Update prover to use the correct storage oracle (#446) (835dd82)

8.1.0 (2023-11-03)

⚠ BREAKING CHANGES

• Update to protocol version 17 (#384)

Features

• boojum: Adding README to prover directory (#189) (c175033)
• config: Extract everything not related to the env config from zksync_config crate (#245) (42c64e9)
• fri-prover: In witness - panic if protocol version is not available (#192) (0403749)
• merkle tree: Snapshot recovery for Merkle tree (#163) (9e20703)
• Rewrite server binary to use vise metrics (#120) (26ee1fb)
• Update to protocol version 17 (#384) (ba271a5)
• vm: Move all vm versions to the one crate (#249) (e3fb489)

Bug Fixes

• crypto: update snark-vk to be used in server and update args for proof wrapping (#240) (4a5c54c)
• docs: Add links to setup-data keys (#360) (1d4fe69)
• prover-fri: Update setup loading for node agg circuit (#323) (d1034b0)
• prover-logging: tasks_allowed_to_finish set to true for 1 off jobs (#227) (0fac66f)

7.2.0 (2023-10-17)

Features

• boojum: Adding README to prover directory (#189) (c175033)
• fri-prover: In witness - panic if protocol version is not available (#192) (0403749)
• Rewrite server binary to use vise metrics (#120) (26ee1fb)

Bug Fixes

• prover-logging: tasks_allowed_to_finish set to true for 1 off jobs (#227) (0fac66f)

7.1.1 (2023-09-27)

Bug Fixes

• crypto: update harness to fix snark proof verification (#2659) (b48248b)

7.1.0 (2023-09-26)

Features

• proof-compressor: Add explicit verification for wrapped proofs based on config (#2650) (9b36bf3)
• Rewrite libraries to use vise metrics (#2616) (d8cdbe9)

Bug Fixes

• workflow: update workflow to remove downloaded setup data before creating PR (#2642) (b915f41)

7.0.1 (2023-09-22)

Bug Fixes

• prover-fri: added handling for graceful shutdown to update DB status for FRI GPU prover (#2637) (be5f1bf)

7.0.0 (2023-09-21)

⚠ BREAKING CHANGES

• update verification keys, protocol version 15 (#2602)

Features

• update verification keys, protocol version 15 (#2602) (2fff59b)
• vlog: Rework the observability configuration subsystem (#2608) (377f0c5)

Bug Fixes

• crypto: update compressor to pass universal setup file (#2610) (39ea81c)
• prover-fri: move saving to GCS behind flag (#2627) (ed49420)

6.7.0 (2023-09-19)

Features

• prover-fri: added picked-by column in prover fri related tables (#2600) (9e604ab)
• Rework metrics approach (#2387) (4855546)

Bug Fixes

• prover-fri: update node-agg circuit id loading (#2595) (b4b7df0)

6.6.1 (2023-09-18)

Bug Fixes

• crypto: update harness to include proof compression time improvement (#2582) (d560c83)

6.6.0 (2023-09-15)

Features

• prover-fri: insert missing protocol version in FRI witness-gen table (#2577) (b9af6a5)
• prover-server-api: Add SkippedProofGeneration in SubmitProofRequest (#2575) (9c2653e)
• Use tracing directly instead of vlog macros (#2566) (53d53af)

6.5.1 (2023-09-14)

Bug Fixes

• proof-compressor: add blob fetch+save metrics and use pushgateway (#2564) (1fdd347)

6.5.0 (2023-09-14)

Features

• Decrease crate versions back to 0.1.0 (#2528) (adb7614)
• prover-fri: added logic for generating snark VK (#2545) (1c1c21a)
• prover-fri: Restrict prover to pick jobs for which they have vk's (#2541) (cedba03)
• vm: New vm intregration (#2198) (f5e7e7a)

Bug Fixes

• crypto: update crypto to fix snark VK to include gate_selectors_openings_at_z column (#2556) (64bea99)

6.4.0 (2023-09-07)

Features

• prover-fri-compressor: Create a dedicated component for FRI proof conversion (#2501) (cd43aa7)
• prover-fri: use separate object store config for FRI prover components (#2494) (7f2537f)

6.3.0 (2023-09-05)

Features

• prover-fri: Add protocol version for FRI prover related tables (#2458) (784a52b)

Bug Fixes

• api: Use MultiVM in API (#2476) (683582d)
• crypto: update crypto deps boojum+harness, VK, setupdata (#2481) (4db26ef)

6.2.0 (2023-09-01)

Features

• prover-gateway: integrate snark wrapper to transform FRI proof to old (#2413) (60bb26b)

Bug Fixes

• api: fix eth_call for old blocks (#2440) (19bba44)
• crypto: Update generated verification keys + setup data (#2460) (659c228)
• fri-vk: add scheduler vk commitment and expose lib for getting cached commitments (#2446) (caccef4)
• prover-fri: enhance logging (#2453) (6aac273)

6.1.0 (2023-08-25)

Features

• prover-server-split: consume API for fetching proof gen data and submitting proofs (#2365) (6e99471)

6.0.0 (2023-08-23)

⚠ BREAKING CHANGES

• new upgrade system (#1784)

Features

• eth-sender: add support for loading new proofs from GCS (#2392) (54f6f53)
• new upgrade system (#1784) (469a4c3)
• prover-fri: Add socket listener to receive witness vector over network (#2367) (19c9d89)
• prover-fri: Added GPU prover integ test (#2287) (7095acb)
• prover-fri: create lib crate for shared types for FRI prover (#2363) (a42305f)
• prover-fri: update gpu prover to perform repeated assembly generation on separate thread (#2398) (0881ee8)
• prover-server-split: expose API from server for requesting proof gen data and submitting proof (#2292) (401d0ab)
• setup-data-fri: save finalization hints in file to be used for external synthesizer (#2355) (3405110)
• witness-vector-generator: create docker images for witness vector generator (#2373) (5b3bc1b)
• witness-vector-generator: Perform circuit synthesis on external machine (#2351) (6839f3f)

Bug Fixes

• crypto: update verification keys for new circuits (#2368) (9377c7a)
• prover-fri: enhance logging + update db queue status which taking job from queue if full (#2395) (50aada8)
• prover-fri: panic in case of proof verification failure (#2388) (a551ff1)

Performance Improvements

• db: Optimize loading L1 batch header (#2343) (1274469)

5.30.1 (2023-08-11)

Bug Fixes

• prover-fri: GPU proving use init_cs_for_external_proving with hints (#2347) (ca6866c)

5.30.0 (2023-08-09)

Features

• db: Configure statement timeout for Postgres (#2317) (afdbb6b)
• house-keeper: refactor periodic job to be reusable by adding in lib (#2333) (ad72a16)
• prover-fri: Add concurrent circuit synthesis for FRI GPU prover (#2326) (aef3491)

Bug Fixes

• prover: Kill prover process for edge-case in crypto thread code (#2334) (f2b5e1a)

5.29.0 (2023-08-07)

Features

• prover-fri-gpu: use witness vector for proving (#2310) (0f9d5ee)

5.28.2 (2023-08-04)

Bug Fixes

• doc: update vk setup data generator doc (#2322) (bda18b0)

5.28.1 (2023-08-04)

Bug Fixes

• docs: Add doc for FRI prover and update doc for vk-setup data (#2311) (5e3b706)

5.28.0 (2023-08-04)

Features

• crypto-update: update crypto deps zkevm_circuits + boojum to fix Main VM failures (#2255) (d0f2f87)
• prover-fri: Added vk commitment generator in CI (#2265) (8ad75e0)
• prover-fri: Integrate GPU proving (#2269) (1c6ed33)
• prover-server-split: Enable prover UT in CI (#2253) (79df2a1)
• prover-server-split: unify cargo.lock for prover component (#2248) (0393463)
• setup-data-fri: use improved method for GpuSetup data (#2305) (997efed)
• Update RockDB bindings (#2208) (211f548)
• vk-setup-data-fri: expose GPU setup & seggegate GPU setup loading based on feature flag (#2271) (bfcab21)

Bug Fixes

• api: Fix bytes deserialization by bumping web3 crate version (#2240) (59ef24a)
• prover: Panics in send_report will make provers crash (#2273) (85974d3)

5.25.0 (2023-08-02)

Features

• crypto-update: update crypto deps zkevm_circuits + boojum to fix Main VM failures (#2255) (d0f2f87)
• prover-fri: Added vk commitment generator in CI (#2265) (8ad75e0)
• prover-fri: Integrate GPU proving (#2269) (1c6ed33)
• prover-server-split: Enable prover UT in CI (#2253) (79df2a1)
• prover-server-split: unify cargo.lock for prover component (#2248) (0393463)
• Update RockDB bindings (#2208) (211f548)
• vk-setup-data-fri: expose GPU setup & seggegate GPU setup loading based on feature flag (#2271) (bfcab21)

Bug Fixes

• api: Fix bytes deserialization by bumping web3 crate version (#2240) (59ef24a)
• prover: Panics in send_report will make provers crash (#2273) (85974d3)