Did you know that you can navigate the posts by swiping left and right?

Agentpalooza Rapid creation and deployment of embodied conversational agents

01 May 2012 . Category . Comments #research #invitedtalk #guru #agents

Abstract and materials

Installer and slides are available now!!!

Embodied conversational agents are virtual characters that engage users in conversation with appropriate speech, gesture, and facial expression. The high cost of developing embodied conversational agents has led to a recent increase in open-source agent platforms. In this tutorial, we present a framework for the rapid creation and deployment of embodied conversational agents. The tutorial will introduce novices to the basic concepts involved in creating ECAs. The tutorial will further describe a content creation pipeline that allows users to use a mixture of low cost and free tools to create customized virtual humans, animate them using motion capture, and deploy them as intelligent interfaces via the XNA Framework. The material covered in the tutorial is suitable both as a starting point for the development of a more advanced system or as a teaching tool for AI curricula.

The tutorial requires no prerequisite knowledge for ECA creation. However, for integration with an intelligent interface, some familiarity with Visual Studio will be useful.

Tutorial Syllabus

  1. Motivation
  2. Conceptual Background
    1. Basic 3D concepts
    2. Face
    3. Body
    4. Code
  3. FaceGen
    1. Parametric face modeling
    2. Photo fitting
    3. Export
  4. Daz3D
    1. Genesis
    2. FaceGen import
    3. Viseme filtering
    4. FBX export
  5. 3ds Max
    1. Object hierarchy
    2. MaxScript
  6. iPi
    1. Kinect motion capture
    2. Skeleton targeting
    3. Exporting morph targets
    4. Exporting skinned animation
  7. XNA
    1. XNAgent overview
    2. Configuring you project
    3. Changing text to speech
    4. Scripting speech with animation
    5. Conclusion