Human Feedback and Knowledge Discovery: Towards Cognitive Systems Optimization

Current computer vision systems, especially those using machine learning techniques are data-hungry and frequently only perform well when dealing with patterns they have seen before. As an alternative, cognitive systems have become a focus of attention for applications that involve complex visual scenes, and in which conditions may vary. In theory, cognitive applications uses current machine learning algorithms, such as deep learning, combined with cognitive abilities that can broadly generalize to many tasks. However, in practice, perceiving the environment and adapting to unforeseen changes remains elusive, especially for real time applications that has to deal with high-dimensional data processing with strictly low latency. The challenge is not only to extract meaningful information from this data, but to gain knowledge and also to discover insight to optimize the performance of the system. We envision to tackle these difficulties by bringing together the best of machine learning and human cognitive capabilities in a collaborative way. For that, we propose an approach based on a combination of Human-in-the-Loop and Knowledge Discovery in which feedback is used to discover knowledge by enabling users to interactively explore and identify useful information so the system can be continuously trained to gain previously unknown knowledge and also generate new insights to improve human decisions.