The UDS index is at the center of the deduplication capability of the dm-vdo device mapper target. The UDS index holds the metadata that allows dm-vdo to find duplicate blocks quickly with minimal storage overhead. The index is highly optimized to take advantage of common properties of real world data sets. This might be useful in other data processing environments besides block storage as in dm-vdo.
This presentation will explore the inner workings of the UDS index and the tradeoffs that lead to effiency but also determine what it can and cannot do.