--dedup Xtool ~upd~ Jun 2026

Run XTool with a smaller minimum chunk size to maximize space savings (at the cost of speed):

| Flag | Default | Description | | :--- | :--- | :--- | | --xtool-min-chunk | 4KB | Minimum chunk size. Smaller sizes increase deduplication ratio but increase metadata overhead. | | --xtool-max-chunk | 64KB | Maximum chunk size. Larger sizes improve throughput but may reduce deduplication efficiency. | | --xtool-cache | Local | Location for the deduplication fingerprint cache. | --dedup xtool

Modern versions (ES_R45 and later) use to virtually eliminate hash collisions during deduplication. 3. Workflow Integration Run XTool with a smaller minimum chunk size

The --dedup xtool flag enables the deduplication engine for processing input datasets. This method optimizes storage and processing time by identifying and eliminating redundant copies of data blocks or files. Larger sizes improve throughput but may reduce deduplication