From 2009 to 2011 I worked on the ATLAS project (Automatic Translation into Sign Language).
The goal fo the ATLAS project is to build an automatic system generating Italian Sign Language animations from written text.
This ambitious project involves several partners taking care of the various stages of the translation.
The folowing video gives an overview of the project:
Within ATLAS I tool care of the procedural animation of the virtual interpreter. A custom animation engine (based on Enthusiasm, and thus on Ogre3D) has been developed to mix – in real time – all the independent communicative channels on the sign language (hand gestures, eye movement, mouth/lips, eyebrows, head, …). A big effort I put is in the IK-based routins to reposition signs in space. All the development I made is in C/C++ and has been recently integrated in the Enthusiasm framework.
A number of publications exist on the subject.
Vincenzo Lombardo, Cristina Battaglino, Rossana Damiano, and Fabrizio Nunnari. 2011. An Avatar-based Interface for the Italian Sign Language. In Proceedings of the 2011 International Conference on Complex, Intelligent, and Software Intensive Systems (CISIS ’11). IEEE Computer Society, Washington, DC, USA, 589-594. DOI=10.1109/CISIS.2011.97 http://dx.doi.org/10.1109/CISIS.2011.97
Vincenzo Lombardo, Fabrizio Nunnari, and Rossana Damiano. 2010. A virtual interpreter for the Italian sign language. In Proceedings of the 10th international conference on Intelligent virtual agents (IVA’10), Jan Allbeck, Norman Badler, Timothy Bickmore, Catherine Pelachaud, and Alla Safonova (Eds.). Springer-Verlag, Berlin, Heidelberg, 201-207. http://dl.acm.org/citation.cfm?id=1889075.1889100