Interpersonal Eye Gaze from Conventional Video
We introduce the Interpersonal-Calibrating Eye-gaze Encoder (ICE), which automatically extracts interpersonal gaze from video recordings without specialized hardware and without prior knowledge of participant locations.
Understanding Credibility
Can you tell when someone is lying to you?
TED Talk Analysis
Telling a great story often involves a deliberate alteration of emotions. In this paper, we objectively measure and analyze the narrative trajectories of stories in public speaking and their impact on subjective ratings.
LISSA – Live Interactive Social Skills Assistance
The LISSA system aims to help individuals improve their conversational skills by simulating face-to-face conversation and providing both real-time as well as post-session summary feedback on users’ nonverbal behavior.
Aging and Engaging
Imagine deploying a fully automated conversational system with sensing and language understanding to older adults to improve their social skills. We show that w/ 8 sessions over several weeks, socially isolated older adults can retain and generalize the skills with other humans.
HEART
Currently, stroke is the leading cause of adult disability in the US. Most of the stroke patients suffer from great difficulties and they need a better way to boost their rehabilitation process.
CoCo: Collaboration Coach
We present and discuss a fully-automated collaboration system, CoCo, that allows multiple participants to video chat and receive real-time and post feedback.
ROC Speak
ROC Speak is a platform that allows you to record your speech on the browser and receive automated feedback on many aspects. In addition, you may share your video to receive personal feedback.
ROC Comment
ROC Comment is an automated interface for generating natural language comments on behavioral videos.
Automated Prediction of Job Interview Performances
Ever wondered why you have been rejected from a job despite being a qualified candidate? What went wrong?
AutoManner
Many individuals exhibit unconscious body movements called mannerisms while speaking. These repeated changes often distract the audience when not relevant to the verbal context.
Vowel Shape
Vowel Shape is an application that helps singers perfect their vowels through an interactive feedback interface.
Rhema
Rhema (“Utterance” or “Things Said” in Greek) a.k.a. ROCSpeak_Glass is a Google Glass-based application to help people in public speaking.
My Automated Conversation coacH (MACH)
MACH, My Automated Conversation coacH, is a system for people to practice social interactions in face-to-face scenarios.
Online Python Tutor
Online Python Tutor is a free educational tool that helps students overcome a fundamental barrier to learning programming: understanding what happens as the computer executes each line of a program’s source code.
Legion: Scribe
Real-time captioning converts aural speech into text within a few seconds.
Legion
Crowdsourcing has been shown to be effective at solving problems that are beyond the capabilities of current automated approaches.
Chorus
Automated systems are not yet able to engage in a robust dialogue with users due to the complexity and ambiguity of natural language. However, humans can easily converse with one another and maintain a shared history of past interactions.
VizWiz
VizWiz is an iPhone application aimed at enabling blind people to recruit remote sighted workers to help them with visual problems in nearly real-time.