Bayesian decision theory and psychophysics
We argue that Bayesian decision theory provides a good theoretical framework for visual perception Such a theory involves a likelihood function specifying how the scene generates the image s a prior assumption about the scene and a decision rule to determine the scene interpretation This is illustrated by describing Bayesian theories for individual visual cues and showing that perceptual biases found in psychophysical experiments can be interpreted as biases towards prior assumptions made by the visual system We then describe the implications of this framework for the integration of di erent cues We argue that the dependence of cues on prior assumptions means that care must be taken to model these dependencies during integration This suggests that a number of proposed schemes for cue integration which only allow weak interaction between cues are not adequate and instead stronger coupling is often required These theories require the choice of decision rules and we argue that this choice is important since these rules help capture the task dependent nature of vision This is illustrated by analysing the generic viewpoint assumption Finally we suggest that the visual system uses a set of competing prior assumptions rather than the single generic priors or natural constraints commonly used in computational theories of vision