homeresources & publications › logic and mrf circuitry for labeling occluding and thinline visual contours

TECHNICAL PUBLICATIONS:

Logic and MRF circuitry for labeling occluding and thinline visual contours

 

This paper presents representation and logic for labeling contrast edges and ridges in visual scenes in terms of both surface occlusion (border ownership) and thinline objects. In natural scenes, thinline objects include sticks and wires, while in human graphical communication thinlines include connectors, dividers, and other abstract devices. Our analysis is directed at both natural and graphical domains. The basic problem is to formulate the logic of the interactions among local image events, specifically contrast edges, ridges, junctions, and alignment relations, such as to encode the natural constraints among these events in visual scenes. In a sparse heterogeneous Markov Random Field framework, we define a set of interpretation nodes and energy/potential functions among them. The minimum energy configuration found by Loopy Belief Propagation is shown to correspond to preferred human interpretation across a wide range of prototypical examples including important illusory contour figures such as the Kanizsa Triangle, as well as more difficult examples. In practical terms, the approach delivers correct interpretations of inherently ambiguous hand-drawn box-and-connector diagrams at low computational cost.

 
citation

Saund, E. Logic and MRF circuitry for labeling occluding and thinline visual contours. 19th Annual Conference on Neural Information Processing Systems (NIPS 2005); 2005 December 5-9; Vancouver; BC; Canada.