Human-Robot Vocal Interaction

The Human and Robot vocal interaction is composed of tree functional subsets: Speach to text, Text processing, Text to speach. The speach to text subset process the voice signal into text according to a given language (dictionary and grammar) and additional...

Robot Navigation

The navigation challenge has already been addressed by the CPE Lyon team during the robocup@work challenge. The current video shows some navigation processing using the Kuka Youbot robot  and the navigation layer of ROS. Note that in the current configuration, the...

Object Recognition

Object Recognition and Localisation Concerning the object recognition part, we use the Xtion PRO Live in order to combine 3D point cloud and RGB data to discriminate objects and localize them. The first step of our process is to isolate objets on a plane surface. To...

Object Pick and Place

Our robot arm is a 7 DoF custom arm made of 1 prismatic joint (elavator) and 6 revolute joints. The prismatic joint is moved by a DC motor and and a ball screw. The 6 revolute joints are made with MX-106 and MX-64 Dynamixel motors. For the moment, the gripper is made...

People Detection and Following

Tracking people through KinectV2 The people tracking task is made thanks to both KinectV2 skeleton extraction and pedestrian detection through laser information (not yet implemented). We use the KinectV2 to take advantage of its API by getting information like general...

Sound Localization

Sound Localization trials Concerning speech recognition and audio detection test, the work is in progress. The current test solutions are : Concerning the sound localization, an ad hoc microphone system based on 8 MEMS MP34DT01, 2 shields X-NUCLEO-CCA02M1 and...