Skip to content

Zygo/bees

Folders and files

NameName
Last commit message
Last commit date

Latest commit

author
Zygo Blaxell
Feb 18, 2025
47243ae · Feb 18, 2025
Nov 17, 2016
Feb 7, 2025
Feb 11, 2025
Feb 9, 2025
Jan 20, 2025
Feb 18, 2025
Dec 1, 2024
Nov 30, 2021
Nov 17, 2016
Dec 23, 2022
Jan 28, 2023
Jan 12, 2025
Nov 30, 2021

Repository files navigation

BEES

Best-Effort Extent-Same, a btrfs deduplication agent.

About bees

bees is a block-oriented userspace deduplication agent designed to scale up to large btrfs filesystems. It is an offline dedupe combined with an incremental data scan capability to minimize time data spends on disk from write to dedupe.

Strengths

  • Space-efficient hash table - can use as little as 1 GB hash table per 10 TB unique data (0.1GB/TB)
  • Daemon mode - incrementally dedupes new data as it appears
  • Largest extents first - recover more free space during fixed maintenance windows
  • Works with btrfs compression - dedupe any combination of compressed and uncompressed files
  • Whole-filesystem dedupe - scans data only once, even with snapshots and reflinks
  • Persistent hash table for rapid restart after shutdown
  • Constant hash table size - no increased RAM usage if data set becomes larger
  • Works on live data - no scheduled downtime required
  • Automatic self-throttling - reduces system load
  • btrfs support - recovers more free space from btrfs than naive dedupers

Weaknesses

Installation and Usage

Recommended Reading

More Information

Bug Reports and Contributions

Email bug reports and patches to Zygo Blaxell [email protected].

You can also use Github:

    https://github.com/Zygo/bees

Copyright & License

Copyright 2015-2025 Zygo Blaxell [email protected].

GPL (version 3 or later).