Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gmp: Skip WAL (passthrough) if no PRW is specified, normal agent mode otherwise. #207

Draft
wants to merge 1 commit into
base: release-2.45.3-gmp
Choose a base branch
from

Conversation

bwplotka
Copy link
Collaborator

@bwplotka bwplotka commented Oct 7, 2024

Before this change GMP fork in agent mode for 2.45.3 will write data to agent DB/WAL and rely on truncation to remove the entries. This is wasteful if no PRW is configured as we have a side channel for GCM export.

This change literally skips all sample appends if no PRW is configured. This effectively keeps agent DB/WAL always empty. If new configuration comes in with PRW entry, the append is enabled and all should work as in vanilla Prometheus.

This should give us maximum efficiency, while keeping agent mode smooth for everyone. This also allows experiments with "passthrough" mode (no WAL/persistence mode) in future of Prometheus.

@bwplotka
Copy link
Collaborator Author

bwplotka commented Oct 8, 2024

Kind of works, but some statistical bugs are there, to investigate:

image

@bwplotka
Copy link
Collaborator Author

bwplotka commented Oct 8, 2024

As per bwplotka/prombenchy#14:

CPU is same/similar to srv mode or unchanged agent. Memory is initially much better, but then leaking (for both this PR and unchanged agent, confirming what some cx saw). To be investigated.

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant