Detecting object boundaries is crucial for recognition, but how the process unfolds in visual cortex remains unknown. To study the problem faced by a hypothetical boundary cell, and to predict how cortical circuitry could produce a boundary cell from a population of conventional “simple cells”, we labeled 30,000 natural image patches and used Bayes’ rule to help determine how a simple cell should influence a nearby boundary cell depending on its relative offset in receptive field position and orientation. We identified three basic types of cell-cell interactions: rising and falling interactions with a range of slopes and saturation rates, as well as non-monotonic (bump-shaped) interactions with varying modes and amplitudes. Using simple models we show that a ubiquitous cortical circuit motif consisting of direct excitation and indirect inhibition – a compound effect we call "incitation" – can produce the entire spectrum of simple cell-boundary cell interactions found in our dataset. Moreover, we show that ...