Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test/pack mine tests 2024115 #654

Draft
wants to merge 37 commits into
base: master
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
d0765bf
feat: make the genesis data deterministic
JamesPiechota Nov 15, 2024
42dcb3c
feat: add support for an e2e test mode
JamesPiechota Nov 17, 2024
58acc43
fixup! feat: add support for an e2e test mode
JamesPiechota Nov 17, 2024
a316d37
fixup! feat: add support for an e2e test mode
JamesPiechota Nov 17, 2024
04afded
fixup! feat: add support for an e2e test mode
JamesPiechota Nov 17, 2024
c395413
WIP
JamesPiechota Nov 18, 2024
d36628e
fixup! feat: add support for an e2e test mode
JamesPiechota Nov 18, 2024
210a74f
fixup! feat: add support for an e2e test mode
JamesPiechota Nov 18, 2024
288c182
Basics of the e2e test
JamesPiechota Nov 18, 2024
37cabfe
fixup! Basics of the e2e test
JamesPiechota Nov 19, 2024
7cb353e
first full spora-spora sync test
JamesPiechota Nov 19, 2024
3afa7cf
multiple sync/pack/mine permutations
JamesPiechota Nov 20, 2024
d4bc0b3
Add wallet fixtures
JamesPiechota Nov 20, 2024
39a2abd
Add regression test to e2e test
JamesPiechota Nov 20, 2024
9994e30
Add unpacked->packed sync/pack/mine tests
JamesPiechota Nov 20, 2024
e87e1cb
Rename ar_pack_mine_tests to ar_sync_pack_mine_tests
JamesPiechota Nov 20, 2024
df8db45
refactor: move helpers into ar_e2e
JamesPiechota Nov 21, 2024
1a27688
First pass at repack_mine test
JamesPiechota Nov 21, 2024
c451eeb
repack_mine_tests are complete
JamesPiechota Nov 21, 2024
c09e523
fixup! repack_mine_tests are complete
JamesPiechota Nov 21, 2024
b684c6c
Get repack_mine_tests working
JamesPiechota Nov 21, 2024
8a80fdd
WIP
JamesPiechota Nov 22, 2024
73c0775
WIP
JamesPiechota Nov 24, 2024
f7fc71c
Try runnig with slower VDF on tests - maybe fixes some flakiness
JamesPiechota Nov 29, 2024
bd32945
Revert "Try runnig with slower VDF on tests - maybe fixes some flakin…
JamesPiechota Nov 29, 2024
d965071
Initialize poa caches for initial block cache blocks
vird Oct 26, 2024
4cf042c
Add Packing Difficulty in v2_index_data_size_by_packing (#649)
humaite Nov 28, 2024
61e39e0
feat: update ar_doctor_bench to use ar_mining_io
JamesPiechota Nov 27, 2024
04e98ae
fix: Run one io thread per os device rather than per storage module
JamesPiechota Nov 28, 2024
2262b46
Improve ar_tx_emitter performance
humaite Nov 28, 2024
9f42a13
Fix High Load Average on Transaction Interface
humaite Nov 25, 2024
e664ee6
fix: start_from_latest_state failed due to missing reward_history
JamesPiechota Nov 29, 2024
37720ef
fix: verify tool will advance past `invalid_iterator` error
JamesPiechota Nov 29, 2024
27c7e9a
fix: fix the broken mining report if there are two packings detected`
JamesPiechota Nov 29, 2024
3dd879e
fixup! fix: fix the broken mining report if there are two packings de…
JamesPiechota Nov 29, 2024
e6c1e4c
fixup! fix: fix the broken mining report if there are two packings de…
JamesPiechota Nov 29, 2024
4c7d0a3
WIP
JamesPiechota Dec 1, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Add Packing Difficulty in v2_index_data_size_by_packing (#649)
This commit adds the packing difficulty in `v2_index_data_size_by_packing`
metric.

see: ArweaveTeam/arweave-dev#568
  • Loading branch information
humaite authored and JamesPiechota committed Dec 1, 2024
commit 4cf042cc573444f3710464f27e49d2a34d7aa9b6
5 changes: 3 additions & 2 deletions apps/arweave/src/ar_metrics.erl
Original file line number Diff line number Diff line change
Expand Up @@ -158,10 +158,11 @@ register() ->
]),
prometheus_gauge:new([
{name, v2_index_data_size_by_packing},
{labels, [store_id, packing, partition_number, storage_module_size, storage_module_index]},
{labels, [store_id, packing, partition_number, storage_module_size, storage_module_index,
packing_difficulty]},
{help, "The size (in bytes) of the data stored and indexed. Grouped by the "
"store ID, packing, partition number, storage module size, "
"and storage module index."}
"storage module index, and packing difficulty."}
]),

%% Disk pool.
Expand Down
5 changes: 4 additions & 1 deletion apps/arweave/src/ar_mining_stats.erl
Original file line number Diff line number Diff line change
Expand Up @@ -163,8 +163,11 @@ set_storage_module_data_size(
StoreLabel = ar_storage_module:label_by_id(StoreID),
PackingLabel = ar_storage_module:packing_label(Packing),
try
PackingDifficulty = get_packing_difficulty(Packing),
prometheus_gauge:set(v2_index_data_size_by_packing,
[StoreLabel, PackingLabel, PartitionNumber, StorageModuleSize, StorageModuleIndex],
[StoreLabel, PackingLabel, PartitionNumber,
StorageModuleSize, StorageModuleIndex,
PackingDifficulty],
DataSize),
ets:insert(?MODULE, {
{partition, PartitionNumber, storage_module, StoreID, packing, Packing}, DataSize})
Expand Down