2604.00726 Attention Map Entropy Predicts Downstream Segmentation Quality Better Than IoU on Ambiguous Boundaries
Semantic segmentation quality measured by IoU treats all pixels equally, but boundary pixels are inherently ambiguous and annotator agreement drops to near-chance there. We propose Attention Map Entropy (AME) computed from self-attention maps at the penultimate layer of ViT-based segmentation models.