Rocapal visual attention 3D

• Project Name: 3D Reconstruction by means of visual attention system

• Authors: Roberto Calvo Palomino (rocapal [at] gsyc [dot] es) and Jose María Cañas Plaza (jmplaza [at] gsyc [dot] es)

• Academic Year: 2007-2008

• Degree: Grad

• Jde Version: jde-4.2.1

• SVN Repository: https://svn.jde.gsyc.es/users/rocapal/attention

• Tags: vision, attention, 3D, saliency, correlation, convergence

• Technology: c, c++, jde suite, openGL, opencv

• State: Finished

• Source License: GPLv3

• Document License: Creative Commons Attribution-Share Alike 3.0 Unported License

• Abstract:

This current project develops a visual attention system for a mobile robot that generates representation of 3D environment. For this, the attentive control is based on a map of salience on the relevant objects in the image. Through a pair of cameras and analyse of the real images, we can such localize relevant objects in the 3D world. The system attentive scheduled analyzes the image in a way similar to what makes a human eye, looking at things that focus to attention: colors, edges, motion or prior knowledge of the objects in reality. Some theories argue that the human visual system ihas limited capacity of processing, and the attention acts as neuronal filter that selects the information, should be procesed in every moment.

• Documentation:

Masther Thesis: PDF - Docs_Sources

• Videos:

3D Reconstruction

The system works fine. The system represents in 3D a complex figure, as a hand.

The system is autonomous. The system represents the information of the cameras in 3D. In the next video you can see the representation in 3D of the scene.

Cognitive Saliency

Added new feateure. A cognitive saliency can make assumptions about the fourth corner of a square.

Tracking objects

In this example the system follows one object.

In this example the system follows two object.

Attention system

You can see in the next video how the movement of the cars is followed by the "virtual eye". The system works with saliency map that decide the target.

• Evolution:

• More information: