Research works

Image Presentation

  • Affective Computing
  • INTELLIGENT COMPUTER VISION SYSTEMS
  • ONE BIT SYSTEM

Affective computing is the study and development of systems and devices that can recognize, interpret, process, and simulate human affects.

Experiment result:



The complexity of intelligent computer vision systems demands novel system architectures that are capable of integrating various computer vision algorithms into a working system with high scalability. The real-time applications of human-centered computing are based on multiple cameras in current systems, which require a transparent distributed architecture. This paper presents an Application-oriented Service Share Model for the generalization of vision processing. Based on the model, a vision system architecture is presented that can readily integrate computer vision processing and make application modules share services and exchange messages transparently. The architecture provides a standard interface for loading various modules, and a mechanism for modules to acquire inputs and publish processing results that can be used as inputs by others. Using this architecture, a system can load specific applications without considering the common low layer data processing. We have implemented a prototype vision system based on the proposed architecture. The latency performance and 3D track function was tested with the prototype system. The architecture is scalable and open, so it will be useful for supporting the development of an intelligent vision system, as well as a distributed sensor system.

The brain computer interaction program is supported by National 863 Program""Visual Assisted Brain Computer Interaction" & NSFC Major Research Plan "Cognitive Computing of Visual and Auditory Information".

A special 7-key keyboard and an input method is developed for inputting Chinese characters, The jey plays one-by-one with its notes, the user can think "click" when he/she want to click the key.

The 6-key keyboards is integrated with a Text-To-Speech, in which the avatar speaks sound of the words user input. Therefore, the user can use this system to "talk" with their physicians and families.

The mouse is driven by 6-Key, which flick one-by-one. User can move and click the mouse via thinking "click". By this system, patients can use the full function of computer controlled by a mouse.