Vision-based speaker detection using Bayesian networks

TitleVision-based speaker detection using Bayesian networks
Publication TypeConference Paper
Year of Publication1999
AuthorsRehg, J. M., K. P. Murphy, and P. Fieguth
Conference Name1999 Conference on Computer Vision and Pattern Recognition
KeywordsBayesian networks, belief networks, Computer Vision, speaker detection, user interfaces, vision sensors

The development of user interfaces based on vision and speech requires the solution of a challenging statistical inference problem: The intentions and actions of multiple individuals must be inferred from noisy and ambiguous data. We argue that Bayesian network models are an attractive statistical framework for cue fusion in these applications. Bayes nets combine a natural mechanism for expressing contextual information with efficient algorithms for learning and inference. We illustrate these points through the development of a Bayes net model for detecting when a user is speaking. The model combines four simple vision sensors: face detection, skin color, skin texture, and mouth motion. We present some promising experimental results