Hierarchical Histogram Threshold Segmentation

Auto-terminating High-detail Oversegmentation

Technische Hochschule Nuernberg, Game Tech Lab
CVPR 2024
HHTS teaser

Capture many image details with few segments.


Superpixels play a crucial role in image processing by partitioning an image into clusters of pixels with similar visual attributes. This facilitates subsequent image processing tasks, offering computational advantages over the manipulation of individual pixels. While numerous oversegmentation techniques have emerged in recent years, many rely on predefined initialization and termination criteria. In this paper, a novel top-down superpixel segmentation algorithm called Hierarchical Histogram Threshold Segmentation (HHTS) is introduced. It eliminates the need for initialization and implements auto-termination, outperforming state-of-the-art methods w.r.t boundary recall. This is achieved by iteratively partitioning individual pixel segments into foreground and background and applying intensity thresholding across multiple color channels. The underlying iterative process constructs a superpixel hierarchy that adapts to local detail distributions until color information exhaustion. Experimental results demonstrate the superiority of the proposed approach in terms of boundary adherence, while maintaining competitive runtime performance on the BSDS500 and NYUV2 datasets. Furthermore, an application of HHTS in refining machine learning-based semantic segmentation masks produced by the Segment Anything Foundation Model (SAM) is presented.

High-Detail Oversegmentation with Minimal Parameter Fine-Tuning

Video Presentation

Simultaneous Multi-Level Resolution



    author    = {Chang, Thomas V. and Seibt, Simon and von Rymon Lipinski, Bartosz},
    title     = {Hierarchical Histogram Threshold Segmentation - Auto-terminating High-detail Oversegmentation},
    booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
    month     = {June},
    year      = {2024},
    pages     = {3195-3204}