Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stats/Metrics tracking db operations #117

Open
zaidoon1 opened this issue Jan 2, 2025 · 1 comment
Open

Stats/Metrics tracking db operations #117

zaidoon1 opened this issue Jan 2, 2025 · 1 comment
Labels
api enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed

Comments

@zaidoon1
Copy link

zaidoon1 commented Jan 2, 2025

Similar to rocksdb, it would be nice if we have access to various stats about the db: https://github.com/facebook/rocksdb/wiki/Statistics

things like:

  • db size
  • number of sst files
  • number of kvs
  • number of tombstones
  • number of levels
  • number of memtables, their current size
  • number of entries in memtables, number of tombstones
  • number of flushes
  • number of compactions happening
  • usefulness of bloom filters (HITs vs MISS), how many operations to disk were filtered out, how many operations to disk were not filtered out
  • etc..
@zaidoon1 zaidoon1 changed the title Status/Metrics for internal operations Stats/Metrics tracking db operations Jan 2, 2025
@marvin-j97 marvin-j97 added enhancement New feature or request help wanted Extra attention is needed good first issue Good for newcomers api labels Jan 2, 2025
@marvin-j97
Copy link
Collaborator

marvin-j97 commented Jan 2, 2025

Some of these are already available:

and some are not exposed yet, but technically exist:

Tracking block cache and bloom filter (and maybe file descriptor cache) hits/misses should probably be behind a feature flag

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants