2024

Zhou X, Zhou Y, Gong Y, Cai Z, Qiu A, Xiao Q, Antle AN, Bai Z. “Bee and I need diversity!” Break Filter Bubbles in Recommendation Systems through Embodied AI Learning. In Proceedings of the 23rd Annual ACM Interaction Design and Children Conference 2024 Jun 17 (pp. 44-61).

Zhou X, Tang J, Lyu H, Liu X, Zhang Z, Qin L, Au F, Sarkar A, Bai Z. Creating an authoring tool for K-12 teachers to design ML-supported scientific inquiry learning. In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems 2024 May 11 (pp. 1-7).

Zhou X, Xiong P, Xiao Q, Bai Z. OptiDot: An Optical Interface for Children to Explore Dot Product and AI Recommendation. In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems 2024 May 2 (pp. 1-7).

K. G. Haut, R. Epstein, T. M. Carroll, B. Kane, L. Schubert, E. Hoque, SOPHIE: Testing a Virtual, Interactive, AI-Augmented End-of-Life Communication Training Tool (RP122), Journal of Pain and Symptom Management, Vol 67, Issue 5, Elsevier

J. Spann, S. A. Chen, T. Ashizawa, E. Hoque, Getting on the Right Foot: Using Observational and Quantitative Methods to Evaluate Movement Disorders, Proceedings of the 29th International Conference on Intelligent User Interfaces, Mar 2024

Gong Y, Zhou X, Zhou Y, Luehmann A, Han Y, Bai Z. Approaching “Filter Bubble” in Recommendation Systems: A Transformative AI Literacy Learning Experience. In Proceedings of the 18th International Conference of the Learning Sciences-ICLS 2024, pp. 490-497 2024. International Society of the Learning Sciences.

Zhou X, Tang J, Xiao Q, Zhou Y, Bai Z. Supporting Multidimensional Data Analysis for High-School Students in the Era of Machine Learning. In Proceedings of the 18th International Conference of the Learning Sciences-ICLS 2024, pp. 1255-1258 2024. International Society of the Learning Sciences.

W. Rahman, A. Abdelkader, S. Lee, P. Yang, M. S. Islam, T. Adnan, M. Hasan, E. Wagner, S. Park, E. R. Dorsey, C. Schwartz, K. Jaffe, E. Hoque, A User-Centered Framework to Empower People with Parkinson’s Disease, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Vol 7, Issue 4, ACM, Jan 2024

2023

E. Hoque, M. S. Rahman, I. Sarker, K. Noshin, S. D. Tithi, S. Lee, W. Rahman, M. S. Islam, T. Adnan, Unmasking Parkinson’s Disease with Smiles: An AI-enabled Screening Framework, Movement Disorders, Vol 38, Wiley (Extended Abstract) 

B. Kane, C. Giugno, L. Schubert, K. Haut, C. Wohn, E. Hoque, Managing Emotional Dialogue for a Virtual Cancer Patient: A Schema-Guided Approach, IEEE Transactions on Affective Computing, 2023

M. S. Islam, S. Lee, A. Abdelkader, S. Park, E. Hoque, PARK: Parkinson’s Analysis with Remote Kinetic-tasks, 11th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), September 2023, Boston, MA.

M. Hasan, C. Ozel, S. Potter, E. Hoque, SAPIEN: Affective Virtual Agents Powered by Large Language Models, 11th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), September 2023, Boston, MA.

K. Haut, C. Wohn, B. Kane, T. Carroll, C. Guigno, V. Kumar, R. Epstein, L. Schubert, E. Hoque, Validating a virtual human and automated feedback system for training doctor-patient communication skills, Affective Computing and Intelligent Interaction (ACII), September 2023, Boston, MA.

M.S. Islam, W. Rahman, A. Abdelkader, S. Lee, P.T. Yang, J.L. Purks, J.L. Adams, R.B. Schneider, E.R. Dorsey, and E. Hoque, Using AI to Measure Parkinson’s Disease Severity at Home, Nature Digital Medicine

W. Rahman, M. Hasan, M. S. Islam, T. Olubajo, J. Thaker, A. Abdelkader, P. Yang, H. Paulson, G. Oz, A. Durr, T. Klockgether, T. Ashizawa, E. Hoque,  Auto-Gait: Automatic Ataxia Risk Assessment with Computer Vision from Gait Task Videos, Proceedings of ACM on Interactive, Mobile, Wearable, and Ubiquitous Computing (IMWUT)

M. S. Islam, A. M. Proma, C. Wohn, K. Berger, S. Uong, V. Kumar, K. S. Korfmacher, E. Hoque, SEER: Sustainable E-commerce with Environmental-impact Rating, Cleaner Environmental Systems, Volume 8, 2023.

2022

R. A. Baten, R. N. Aslin, G. Ghoshal, and M. E. Hoque, Novel idea generation in social networks is optimized by exposure to a ‘Goldilocks’ level of idea-variability, PNAS Nexus, 1(5):pgac255, November 2022.

M. S. Islam, A. Proma, Y. Zhou, S. N. Akter, C. Wohn, E. Hoque, KnowUREnvironment: An Automated Knowledge Graph for Climate Change and Environmental Issues, The Role of AI in Responding to Climate Change, AAAI Fall Symposium Series, November 2022

A. Proma, M. S. Islam, S. Ciko, R. A. Baten, E. Hoque. NADBenchmarks – a compilation of Benchmark Datasets for Machine Learning Tasks related to Natural Disasters. The Role of AI in Responding to Climate Change, AAAI Fall Symposium Series, November 2022

K. Haut, A. Blumenthal, S. Atterbury, X. Zhou, W. Rahman, E. Natali, M. R. Ali, E. Hoque, Assistive Video Filters for People with Parkinson’s Disease to Remove Tremors and Adjust Voice, Affective Computing and Intelligent Interaction (ACII), October 2022 [Best paper nomination]

K. Haut, C. Wohn, V. Antony, A. Goldfarb, M. Welsh, D. Sumanthiran, M. R. Ali, E. Hoque, Systematic Feature Isolation for Bias Research Using Deepfakes, 30th ACM International Conference on Multimedia (ACM MM), October 2022 [Best paper nomination]

Z. Razavi, L. Schubert, K. V. Orden, M. R. Ali, B. Kane, E. Hoque, Discourse Behavior of Older Adults Interacting With a Dialogue Agent Competent in Multiple Topics, ACM Transactions on Intelligent Interactive Systems (TiiS), Vol 12. No. 2, June 2022

T. K. Sen, K. Haut, D. Lomakin, E. Hoque, A Mental Trespass? Unveiling Truth, Exposing Thoughts and Threatening Civil Liberties with Non-Invasive AI Lie Detection, IEEE Transactions on Technology and Society, Vol. 3, No. 3, June 2022

X Zhou, J Tang, B Guo, H Lyu, Z Bai, Challenges and Design Opportunities in Data Analysis for ML-Empowered Scientific Inquiry-Insights from a Teacher Professional Development Study, The International Society of the Learning Sciences Annual Meeting (ISLS 22), Jun 2022.

J Tang, X Zhou, X Wan, M Daley, Z Bai, ML4STEM Professional Development Program: Enriching K-12 STEM Teaching with Machine Learning, International Journal of Artificial Intelligence in Education, 1-40 (ijAIED 22), April 2022.

S. Samrose, E. Hoque, Suggestive Motivational Interviewing Agent for Remote Group Discussion, ACM International Conference on Supporting Group Work (Group 22), Jan 2022.

2021

X Zhou, J Tang, M Daley, S Ahmad, Z Bai, “Now, I Want to Teach It for Real!”: Introducing Machine Learning as a Scientific Discovery Tool for K-12 Teachers, International Conference on Artificial Intelligence in Education, 486-499, Jun 2021

W. Chowdhury et al., Detecting Parkinson’s Disease from an Online Speech-task: Observational Study, Journal of Medical Internet Research (JMIR), Vol 23, No 10, October 2021

M. K. Hasan, J. Spann, M. Hasan, M. S. Islam, K. Haut, R. Mihalcea, and E. Hoque, Hitting your MARQ: Multimodal ARgument Quality Assessment in Long Debate Video. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic. Association for Computational Linguistics

M. R. Ali, T. Myers, E. Wagner, H. Ratnu, E. R. Dorsey, E. Hoque, Facial expressions can detect Parkinson’s disease: preliminary evidence from videos collected online, Nature Digital Medicine, September 2021.

Wasifur Rahman, Sazan Mahbub, Asif Salekin, Md Kamrul Hasan, Ehsan Hoque, HirePreter: A Framework for Providing Fine-grained Interpretation for Automated Job Interview Analysis, in the Second Workshop on Applied Multimodal Affect Recognition (ACII Workshop), 2021.

S. Samrose, and E. Hoque, Quantifying the Intensity of Toxicity for Discussions and Speakers, in the Second Workshop on Applied Multimodal Affect Recognition (ACII Workshop), 2021.

T. K. Sen, G. Naven, L. Gerstner, D. Bagley, R. A. Baten, W. Chowdhury, M. K. Hasan, K. Haut, A. Mamun, S. Samrose, A. S. Slowe, E. Barnes, M. Frank, E. Hoque, DBATES: dataset of DeBate Audio features, Text, and visual Expressions from competitive debate Speeches,  IEEE Transactions on Affective Computing, September 2021   

R. A. Baten, R. N. Aslin, G. Ghoshal, and M. E. Hoque, Cues to gender and racial identity reduce creativity in diverse social networks, Scientific Reports, 11(1):10261, May 2021

M. R. Ali, T. K. Sen, Q. Li, R. Langevin, T. Myers, S. Sharma, E. R. Dorsey, E. Hoque, Analyzing Head Pose in Remotely-Collected Videos of People with Parkinson’s Disease, ACM Transactions on Computing for Healthcare, Vol 2, Issue 4, October 2021

A. Chattoraj, R. Acharyya, S. Das, M. Tanveer, E. Hoque, Removing racial bias in TED talk ratings by awareness of verbal and gesture quality, Responsible AI ICLR 2021 Workshop

A. Zaman, B. Zhang, V. Silenzio, E. Hoque, and H. Kautz, Individual-level Anxiety Detection and Prediction from Longitudinal YouTube and Google Search Engagement Logs, Data for the Wellbeing of Most Vulnerable Workshop, collocated with ICWSM, 2021

K. Sibley, C. Girges, E. Hoque, T. Foltynie, Video-Based Analyses of Parkinson’s Disease Severity: A Brief Review, Journal of Parkinson’s Disease, March 2021.

M. R. Ali, T. K. Sen, B. Kane, S. Bose, T. Carroll, R. Epstein, L. Schubert, E. Hoque, Novel Computational Linguistic Measures, Dialogue System and the Development of SOPHIE: Standardized Online Patient for Healthcare Interaction Education, to appear in IEEE Transactions on Affective Computing arxiv

J. Wang, M. LAvender, E. Hoque, P. Brophy, H. Kautz, A Patient-Centered Digital Scribe for automatic medical documentation, The Journal of The American Medical Informatics Association (JAMIA Open), 2021

M. K. Hasan, S. Lee, W. Rahman, A. Zadeh, R. Mihalcea, L. P. Morency, E. Hoque, Humor Knowledge Enriched Transformer for Understanding Multimodal Humor,  The Thirty-fifth AAAI Conference on Artificial Intelligence (AAAI-21), February 2021 [poster] [github]

R. A. Baten, and E. Hoque, Technology-driven alteration of nonverbal cues and its effects on negotiation, Negotiation Journal, 37(1):35-47, February 2021 [read-only link]

2020

X. Wan, X. Zhou, Z. Ye, C. K. Mortensen, and Z. Bai, SmileyCluster: supporting accessible machine learning in K-12 scientific discovery. In Proceedings of the Interaction Design and Children Conference (IDC ’20), 2020

S. Samrose, R. Rawassizadeh, E. Hoque, Immediate or Reflective?: Effects of Real-time Feedback on Group Discussions over Videochat, arxiv

A. Zaman, H. Kautz, E. Hoque, V. Silenzio, C. Nichols, C. Cerulli, Discovering Intimate Partner Violence from Web Search History, IEEE/ACM International Conference on Connected Health: Applications, Systems, and Engineering Technologies (CHASE), December 2020

M. R. Ali, E. Hoque, P. Duberstein, L. Schubert, S. Z. Razavi, B. Kane, C. Silva, J. S. Daks, M. Huang, K. V. Orden,  Aging and Engaging: A Pilot Randomized Controlled Trial of an Online Conversational Skills Coach for Older Adults, The American Journal of Geriatric Psychiatry (AJGP), December 2020.

B. Zhang, A. Zaman, V. Silenzio, H. Kautz, E. Hoque, The Relationship between Deteriorating Mental Health Conditions and Longitudinal Behavioral Changes in Google and YouTube Usages among College Students in the United States during COVID-19: Observational Study, Journal of Medical Internet Research (JMIR) Mental Health, Nov. 2020.

B. Zhang, A. Zaman, R. Acharya, E. Hoque, V. Silenzio, H. Kautz, Detecting Individuals with Depressive Disorder from Personal Google Search and YouTube History Logs, Machine Learning in Public Health Workshop at NeurIPS, December 2020

M. R. Ali, S. Z. Razavi, R. Langevin, A. A. Mamun, B. Kane, R. Rawassizadeh, L. Schubert, E. Hoque, A Virtual Conversational Agent for Teens with Autism Spectrum Disorder: Experimental Results and Design Lessons, 20th ACM International Conference on Intelligent Virtual Agent (IVA), October 2020

R. A. Baten, D. Bagley, A. Tenesaca, F. Clark, J. P. Bagrow, G. Ghoshal, and M. E. Hoque, Creativity in temporal social networks: How divergent thinking is impacted by one’s choice of peers, Journal of the Royal Society Interface, 17(171):20200667, October 2020 [pdf]

F. Shahid, W. Rahman, M. S. Rahman, S. Purabi, A Seddiqa, M. Mostakim, F. Feroz, T. R. Soron, F. Hossain, N. Khan, A. B. Islam, N. Paul, E. Hoque, A. Islam, Leveraging Free-Hand Sketches for Potential Screening of PTSD, Proceedings of ACM on Interactive, Mobile, Warble, and Ubiquitous Computing (IMWUT), September 2020

E. R. Dorsey et al., Deep Phenotyping of Parkinson’s Disease, Journal of Parkinson’s Disease, May 2020

W. Rahman, M. K. Hasan, S. Lee, A. Zadeh, C. Mao, LP Morency, M. E. Hoque, Integrating Multimodal Information in Large Pretrained Transformers, 2020 Annual Conference of the Association for Computational Linguistics (ACL), Seattle, July 2020

M. R. Ali, J. Hernandez, E. R. Dorsey, M. E. Hoque, D. McDuff, Spatio-Temporal Attention and Magnification for Classification of Parkinson’s Disease from Videos Collected via the Internet, IEEE International Conference on Automated Face and Gesture Recognition (FG), Argentina, May 2020

G. Naven, T. K. Sen, L. Gerstner, K. G. Haut, M. Wen, M. E. Hoque, Leveraging Shared and Divergent Facial Expression Behavior Between Genders in Deception Detection, IEEE International Conference on Automated Face and Gesture Recognition (FG), Argentina, May 2020

M. Tran, T K. Sen, K. G. Haut, M. A., Ali, M. E. Hoque, Are you really looking at me? A Feature-Extraction Framework for Estimating Interpersonal Eye Gaze from Conventional Video, IEEE Transactions on Affective Computing, March 2020

Phyllis Butow, M. E. Hoque, Using Artificial Intelligence to Analyze and Teach Communication in Healthcare, The Breast, Vol. 50, pp. 49-55, April, 2020

2019

M. K. Hasan, W. Rahman, A. Zadeh, J. Zhong, I. Tanveer, LP Mornecy, and M. E. Hoque, UR-FUNNY: A Multimodal Language Dataset for Understanding Humor, 2019 Conference on Empirical Methods in Natural Language Processing, Hong Kong, November 2019 [view poster]

M. K. Hasan, W. Rahman, L. Gerstner, T. K. Sen, S. Lee, K. G. Haut, M. E. Hoque, Facial Expression Based Imagination Index and a Transfer Learning Approach to Detect Deception, 8th International Conference on Affective Computing and Intelligent Interaction (ACII 2019), Cambridge, UK, September 2019

M. R. Ali, T. K. Sen, V-D. Nguyen, R. Rawassizadeh, P. Duberstein, R. Epstein, M. E. Hoque, What Computers Can Teach Us About Doctor-Patient Communication: Leveraging Gender Differences in Cancer Care, 8th International Conference on Affective Computing and Intelligent Interaction (ACII 2019), Cambridge, UK, September 2019

R. A. Baten, F. Clark and M. E. Hoque, Upskilling Together: How Peer-interaction Influences Speaking-skills Development Online, 8th International Conference on Affective Computing and Intelligent Interaction (ACII 2019), Cambridge, UK, September 2019

S. Samrose, W. Chu, C. He, Y. Gao, S. S. Shahrin, Z. Bai, and M. E. Hoque, Visual Cues for Disrespectful Conversation Analysis, 8th International Conference on Affective Computing and Intelligent Interaction (ACII 2019), Cambridge, UK, September 2019

M. K. Hasan, T. K. Sen, Y. Yang, R. A. Baten, K. G. Glenn, and M. E. Hoque, LIWC Into the Eyes: Using Facial Features to Contextualize Linguistic Analysis in Multimodal Communication, 8th International Conference on Affective Computing and Intelligent Interaction (ACII 2019), Cambridge, UK, September 2019

R. Langevin, M. R. Ali, T. Sen, C. Snyder, T. Myers, E. R. Dorsey, M. E. Hoque, The PARK Framework for Automated Analysis of Parkinson’s Disease Characteristics, Proceedings of ACM on Interactive, Mobile, Warble, and Ubiquitous Computing (IMWUT), London, September 2019

F. Shahid, W. Rahman, A. B. Islam, N. Paul, N. Khan, M. S. Rahman, M. M. Haque, A. B. M. A. A. Islam, Two Tell-tale Perspectives of PTSD: Neurobiological Abnormalities and Bayesian Regulatory Network of the Underlying Disorder in a Refugee Context, Proceedings of ACM on Interactive, Mobile, Warble, and Ubiquitous Computing (IMWUT), London, September 2019

I. Tanveer, M. K. Hasan, D. Gildea, M. E. Hoque, A Causality-Guided Prediction of the TED Talk Ratings from the Speech-Transcripts using Neural Networks, arxiv

I. Tanveer, R. Zhao, M. E. Hoque, Automatic Identification of Non-Meaningful Body-Movements and What it Reveals About Humans, arxiv

2018

R. Shafipour, R. A. Baten, M. K. Hasan, G. Ghoshal, G. Mateos, and M. E. Hoque, Buildup of speaking skills in an online learning community: A network-analytic exploration, Palgrave Communications, 4(1):1-10, June 2018

T. Sen, K. Hasan, Z. Teicher, M. E. Hoque, Automated Dydadic Data Recorder (ADDR) Framework and Analysis of Facial Cues in Deceptive Communication, PACM on Interactive, Mobile, Wearable, and Ubiquitous Computing (IMWUT) (to be presented at UbiComp 2018)

S. Samrose, R. Zhao, J. White, V. Li, L. Nova, Y. Lu, M. R. Ali, M. E. Hoque, CoCo: Collaboration Coach for Understanding Team Dynamics during Video Conferencing, PACM on Interactive, Mobile, Wearable, and Ubiquitous Computing (IMWUT) (to be presented at UbiComp 2018)

M. R. Ali, T. K. Sen, D. Crasta, V-D. Nguyen, R. Rogge, M. E. Hoque, The What, When, and Why of Facial Expressions: An Objective Analysis of Conversational Skills in Speed-Dating Videos, IEEE International Conference on Automated Face and Gesture Recognition (FG), China, May 2018

Astha Singhal, M. Rafayet Ali, Raiyan Abdul Baten, Chigusa Kurumada, Elizabeth West Marvin and M. E. Hoque, Analyzing the Impact of Gender on the Automation of Feedback for Public Speaking, In 8th Int. Workshop on Human Behavior Understanding (HBU) in conjunction with IEEE International Conference on Automated Face and Gesture Recognition (FG 2018), Xian, China, 2018.

T. K. Sen, K. Hasan, M. Tran, Y. Yang, M. E. Hoque, Say CHEESE: Common Human Emotional Expression Set Encoder Analysis of Smiles in Honest and Deceptive Communication, IEEE International Conference on Automated Face and Gesture Recognition (FG), China, May 2018

I. Tanveer, S. Samrose, R. A. Baten, M. E. Hoque, How Emotional Trajectories Affect Audience Perception in Public Speaking, The Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), Montreal, Canada, April 2018.

M. R. Ali, K. Orden, K. Parkhurst, V. D. Nguyen, S. Liu, P. Duberstein, M. E. Hoque, Aging and Engaging: A Social Conversational Skills Training Program for Older Adults, ACM Intelligent User Interfaces (IUI), Tokyo, Japan, March 2018

R. Li, J. Curhan, M. E. Hoque, Understanding Social Interpersonal Interaction via Synchronization Templates of Facial Events, The Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), February, 2018.

2017

L. Chen, R. Zhao, B. Lehman, C. Leong, G. Feng, M. E. Hoque, Automated Video Judgement on a Large-Sized Corpus Collected Online, 7th Affective Computing and Intelligent Interaction (ACII), October, 2017. Best Paper Nomination

T. Sen, M. R. Ali, P. Duberstein, R. Epstein, M. E. Hoque, Modeling Doctor-Patient Communication with Affective Text Analysis, 7th Affective Computing and Intelligent Interaction (ACII), October, 2017.

R Zhao, V. Li, H. Barabosa, G. Ghoshal, M. E. Hoque, A Semi-Automated, Collaborative, & Online Training Module for Communication Skills, PACM on Interactive, Mobile, Warble, and Ubiquitous Computing (IMWUT), 2017

S. Z. Razavi, L. Schubert, M. Ali, M. E. Hoque, Managing Causal Spoken Dialogue Using Flexible Schemas, Pattern Transduction Trees, and Gist Clauses, 5th Annual Conference on Advances in Cognitive Systems (ACS), Troy, NY, May 2017

2016

S. Z. Razavi, M. Ali, T. Smith, L. Schubert, M. E. Hoque, The LISSA Virtual Human and ASD Teens: An Overview of Initial Experiments, 16th International Conference on Intelligent Virtual Agent (IVA), Los Angeles, California, September 2016.

I. Naim, I. Tanveer, D. Gildea, M. E. Hoque, Automated Analysis and Prediction of Job Interview Performance, IEEE Transactions on Affective Computing, 2016

M. R. Ali, F. Ciano, R. Zhao, I. Naim, M. E. Hoque, ROC Comment: Automated Descriptive and Subjective Captioning of Behavioral Videos, Proceedings of 17th ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), September 2016.

M. Tanveer, R. Zhao, K. Chen, Z. Tiet, M. E. Hoque, AutoManner: An Automated Interface for Making Public Speakers Aware of Their Mannerisms, ACM Intelligent User Interfaces (IUI), April 2016

2015

M. Tanveer, J. Liu, M. E. Hoque, Unsupervised Extraction of Human-Interpretable Nonverbal Behavioral Cues in a Public Speaking Scenario, ACM Multimedia (ACMMM), 2015

M. Tanveer, E. Lin, M. E. Hoque, Rhema: A Real-Time In-Situ Intelligent Interface to Help People with Public Speaking, ACM Intelligent User Interfaces (IUI), April 2015

M. Fung, Y. Jin, R. Zhao, M. E. Hoque, ROC Speak: Semi-Automated Personalized Feedback on Nonverbal Behavior from Recorded Videos, Proceedings of 17th ACM International Joint Conference on Pervasive and Ubiquitous Computing (Ubicomp), September 2015. Project Site [Video]

M. Ali, D. Crasta, L. Jin, A. Baretto, J. Pachter, R. Rogge, M. E. Hoque, LISSA- Live Interactive Social Skill Assistance, 6th Affective Computing and Intelligent Interaction (ACII), 2015. [Video]

R. Li, J. Curhan, M. E. Hoque, Role of Synchronized Facial Expressions to Predict Negotiation Outcome, IEEE Automated Face and Gesture Recognition (FG), May 2015

I. Naim, I. Tanveer, D. Gildea, M. E. Hoque, Automated Prediction of Job Interview Performance: The Role of What You Say and How You Say It, IEEE Automated Face and Gesture Recognition (FG), May 2015

Philip J. Guo, Jeffery White, Renan Zanelatto, Multi-User Program Visualizations for Real-Time Tutoring and Collaborative Learning, In IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC 2015), Atlanta, Georgia, 2015.

Mitchell Gordon and Philip J. Guo, Codepourri: Creating Visual Coding Tutorials Using A Volunteer Crowd Of Learners, In IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC 2015), Atlanta, Georgia, 2015.

Philip J. Guo, Codeopticon: Real-Time, One-To-Many Human Tutoring for Computer Programming, In ACM Symposium on User Interface Software and Technology (UIST 2015), Charlotte, North Carolina, 2015.

Joyce Zhu, Jeremy Warner, Mitchell Gordon, Jeffery White, Renan Zanelatto, Philip J. Guo, Toward a Domain-Specific Visual Discussion Forum for Learning Computer Programming: An Empirical Study of a Popular MOOC Forum, In IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC 2015), Atlanta, Georgia, 2015.

Parmit K. Chilana, Celena Alcock, Shruti Dembla, Anson Ho, Ada Hurst, Brett Armstrong, Philip J. Guo, Perceptions of Non-CS Majors in Intro Programming: The Case of Interdisciplinary Engineers, In IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC 2015), Atlanta, Georgia, 2015.

Jeremy Warner, John Doorenbos, Bradley N. Miller, Philip J. Guo, How High School, College, and Online Students Differentially Engage with an Interactive Digital Textbook, In The 8th International Conference of Educational Data Mining (EDM 2015), Madrid, Spain, 2015

C. Ryan, K. Ciesinski, M. E. Hoque, Vowel Shapes: An Open-source, Interactive Tool to Assist Singers with Learning Vowels, Proceedings of 17th ACM International Joint Conference on Pervasive and Ubiquitous Computing (Ubicomp), September 2015. [Video]

Elena L. Glassman, Jeremy Scott, Rishabh Singh, Philip J. Guo and Robert C. Miller, OverCode: Visualizing Variation in Student Solutions to Programming Problems at Scale, In Transactions on Computer-Human Interaction (TOCHI 2015), 2015

Carrie J. Cai, Philip J. Guo, James Glass, Robert C. Miller, Wait-Learning: Leveraging Conversational Dead Time for Second Language Education, In ACM Conference on Human Factors in Computing Systems (CHI 2015), 2015

2014

M. Iftekhar Tanveer and Mohammed (Ehsan) Hoque, A Google Glass App to Help the Blind in Small Talk, In ACM SIGACCESS conference on Computers & accessibility (ASSETS 2014), Rochester, NY, 2014

Walter Lasecki, Mitchell Gordon, Danai Koutra, Malte F. Jung, Steven P. Dow and Jeffrey Bigham, Glance: Rapidly Coding Behavioral Video with the Crowd, In ACM Symposium on User Interface Software and Technology (UIST 2014), 2014.

Daniela Retelny, Sebastien Robaszkiewicz, Alexander To, Walter Lasecki, Jay Patel, Negar Rahmati, Tulsee Doshi, Melissa Valentine and Michael S. Bernstein, Expert Crowdsourcing with Flash Teams, In ACM Symposium on User Interface Software and Technology (UIST 2014), 2014. *Best Paper Award

Walter Lasecki, Raja Kushalnagar, Jeffrey Bigham, Helping Students Keep Up with Real-Time Captions by Pausing and Highlighting, In Cross-Disciplinary Conference on Web Accessibility (W4A 2014), 2014

Anna Loparev, Walter Lasecki, Kyle I. Murray, Jeffrey Bigham, Introducing Shared Character Control to Existing Video Games, In Foundations of Digital Interactive Games (FDG 2014), 2014

Walter Lasecki, Leon Weingard, George Ferguson, Jeffrey Bigham, Finding Dependencies Between Actions Using the Crowd, In ACM Conference on Human Factors in Computing Systems (CHI 2014), 2014

Jeffrey Bigham and Walter Lasecki, Crowd Storage: Storing Information on Existing Memories, In ACM Conference on Human Factors in Computing Systems (CHI 2014), 2014

Elena L. Glassman, Jeremy Scott, Rishabh Singh, Philip J. Guo and Robert C. Miller, OverCode: Visualizing Variation in Student Solutions to Programming Problems at Scale, In Transactions on Computer-Human Interaction (TOCHI), 2015.

Juho Kim, Philip J. Guo, Carrie J. Cai, Shang-Wen (Daniel) Li, Krzysztof Z. Gajos and Robert C. Miller, Data-Driven Interaction Techniques for Improving Navigation of Educational Videos, In ACM Symposium on User Interface Software and Technology (UIST 2014), 2014.

Jeremy Scott, Philip J. Guo, Randall Davis, A Direct Manipulation Language for Explaining Algorithms, In IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC 2014), 2014

Juho Kim, Phu Nguyen, Sarah Weir, Philip J. Guo, Robert C. Miller and Krzysztof Z. Gajos, Crowdsourcing Step-by-Step Information Extraction to Enhance Existing How-to Videos, In ACM Conference on Human Factors in Computing Systems (CHI 2014), 2014. Honorable Mention

Philip J. Guo and Katharina Reinecke, Demographic Differences in How Students Navigate Through MOOCs, In ACM Conference on Learning at Scale (L@S 2014), 2014

Philip J. Guo, Juho Kim, Rob Rubin, How Video Production Affects Student Engagement: An Empirical Study of MOOC Videos, In ACM Conference on Learning at Scale (L@S 2014), 2014

Juho Kim, Philip J. Guo, Daniel T. Seaton, Piotr Mitros, Krzysztof Z. Gajos and Robert C. Miller, Understanding In-Video Dropouts and Interaction Peaks in Online Lecture Videos, In ACM Conference on Learning at Scale (L@S 2014), 2014

Anvisha Pai, Philip J. Guo, Robert C. Miller, Modeling Programming Knowledge for Mentoring at Scale, In ACM Conference on Learning at Scale (L@S 2014), 2014

Raja Kushalnagar, Walter S. Lasecki, Jeffrey P. Bigham, Accessibility Evaluation of Classroom Captions, In ACM Transactions on Accessibility (TACCESS 2014), 2014

Walter S. Lasecki, Jaime Teeven, Ece Kamar, Information Extraction and Manipulation Threats in Crowd-Powered Systems, In Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW 2014), Baltimore, MD, 2014

Carrie J. Cai, Philip J. Guo, James Glass and Robert C. Miller, Wait-Learning: Leveraging Conversational Dead Time for Second Language Education, In ACM Conference on Human Factors in Computing Systems (CHI 2015), 2015

2013

Walter S. Lasecki and Jeffrey P. Bigham, Conversations in the Crowd: Collecting Data for Task-Oriented Dialog Learning, In ACM Transactions on Accessibility (HCOMP 2013), Palm Springs, CA, 2013

Walter S. Lasecki, Phyo Thiha, Yu Zhong, Erin Brady and Jeffrey P. Bigham, Answering Visual Questions with Conversational Crowd Assistants, In Proceedings of the ACM Conference on Computers and Accessibility (ASSETS 2013), Bellevue, WA, 2013

Walter S. Lasecki, Rachel Wesley, Jeffrey Nichols, Anand Kulkarni, James F. Allen and Jeffrey P. Bigham, Chorus: A Crowd-Powered Conversational Assistant, In Proceedings of the Symposium on User Interface Software and Technology (UIST 2013), St Andrews, UK, 2013

Walter S. Lasecki, Leon Weingard, George Ferguson and Jeffrey P. Bigham, Crowd Formalization of Action Conditions, In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2013), Bellevue, WA, 2013

Walter S. Lasecki, Leon Weingard, George Ferguson and Jeffrey P. Bigham, Finding Action Dependencies Using the Crowd, In Proceedings of the ACM Conference on Knowledge Capture (KCAP 2013), Banff, CN, 2013

Erin A. Carroll, Mary Czerwinski, Asta Roseway, Ashish Kapoor, Paul Johns, Kael Rowan and M.C. Schraefel, Food and Mood: Just-in-Time Support for Emotional Eating, In Proceedings of IEEE Affective Computing and Intelligent Interaction (ACII 2013), Geneva, Switzerland, 2013

Iftekhar Naim, Daniel Gildea, Walter S. Lasecki and Jeffrey P. Bigham, Text Alignment for Real-Time Crowd Captioning, In Proceedings of the North American Chapter of the Association for Computational Linguistics (NAACL 2013), Atlanta, GA, 2013

Raja Kushalnagar, Walter S. Lasecki, Jeffrey P. Bigham, A Readability Evaluation of Real-Time Crowd Captions in the Classroom, In Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A 2013), Rio de Janeiro, Brazil, 2013

Walter S. Lasecki, Real-Time Conversational Crowd Assistants, In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems Student Research Competition (CHI 2013), Paris, France, 2013

Matthew Murphy, Christopher D. Miller, Walter S. Lasecki, Jeffrey P. Bigham, Adaptive Time Windows for Real-Time Crowd Captioning, In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 2013), Paris, France, 2013

Walter S. Lasecki and Jeffrey P. Bigham, Spoken Control of Existing Mobile Interfaces With the Crowd, In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 2013), Paris, France, 2013

Walter S. Lasecki, Christopher D. Miller, Jeffrey P. Bigham, Warping Time for More Effective Real-Time Crowdsourcing, In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 2013), Paris, France, 2013

Erin Brady, Meredith Ringel Morris, Yu Zhong, Samuel C. White, Jeffrey P. Bigham, Visual Challenges in the Everyday Lives of Blind People, In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 2013), Paris, France, 2013

Walter S. Lasecki, Young Chol Song, Henry Kautz and Jeffrey P. Bigham, Real-Time Crowd Labeling for Deployable Activity Recognition, In Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW 2013), San Antonio, TX, 2013

Erin Brady, Yu Zhong, Meredith Ringel Morris and Jeffrey P. Bigham, Investigating the Appropriateness of Social Network Question Asking as a Resource for Blind Users, In Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW 2013), San Antonio, TX, 2013

2012

Walter S. Lasecki, Anand Kulkarni, Rachel Wesley, Jeffrey Nichols, Chang Hu, James F. Allen, Jeffrey P. Bigham, Chorus: Letting the Crowd Speak with One Voice, In University of Rochester Technical Report (TR 2012), Rochester, NY, 2012

Michele A. Williams (as Michele A. Burton), Erin Brady, Robin Brewer, Callie Neylan, Jeffrey P. Bigham, Amy Hurst, Crowdsourcing Subjective Fashion Advice Using VizWiz: Challenges and Opportunities, In Proceedings of the ACM Conference on Computers and Accessibility (ASSETS 2012), Boulder, CO, 2012

Walter S. Lasecki, Jeffrey P. Bigham, Online Quality Control for Real-Time Crowd Captioning, In Proceedings of the ACM Conference on Computers and Accessibility (ASSETS 2012), Boulder, CO, 2012

Raja Kushalnagar, Walter S. Lasecki, Jeffrey P. Bigham, A Readability Evaluation of Real-Time Crowd Captions in the Classroom, In Proceedings of the ACM Conference on Computers and Accessibility (ASSETS 2012), Boulder, CO, 2012

Walter S. Lasecki, Tessa Lau, Grant He, Jeffrey P. Bigham, Crowd-Based Recognition of Web Interaction Patterns, In Proceedings of the Symposium on User Interface Software and Technology (UIST 2012), Boston, MA, 2012

Walter S. Lasecki, Rachel Wesley, Anand Kulkarni, Jeffrey P. Bigham, Speaking With the Crowd, In Proceedings of the Symposium on User Interface Software and Technology (UIST 2012), Boston, MA, 2012

Young Chol Song, Walter S. Lasecki, Jeffrey P. Bigham, Henry Kautz, Training Activity Recognition Systems Online Using Real-Time Crowdsourcing, In Proceedings of the International Conference on Ubiquitous Computing (UBICOMP 2012), Pittsburgh, PA, 2012

Walter S. Lasecki, Christopher D. Miller, Adam Sadilek, Andrew Abumoussa, Donato Borrello, Raja Kushalnagar, Jeffrey P. Bigham, Real-Time Captioning by Groups of Non-Experts, In Proceedings of the Symposium on User Interface Software and Technology (UIST 2012), Boston, USA, 2012

Preet Singh, Walter S. Lasecki, Paulo Barelli, Jeffrey P. Bigham, HiveMind: A Framework for Optimizing Open-Ended Responses From the Crowd, In University of Rochester Technical Report (TR 2012), Rochester, NY, 2012

Walter S. Lasecki, Jeffrey P. Bigham, James F. Allen, George Ferguson, Real-Time Collaborative Planning with the Crowd, In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2012), Toronto, CAN, 2012

Walter S. Lasecki, Christopher D. Miller, Donato Borrello, Jeffrey P. Bigham, Online Sequence Alignment for Real-Time Audio Transcription by Non-Experts, In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2012), Toronto, CAN, 2012

Walter S. Lasecki, Samuel C. White, Kyle I. Murray, Jeffrey P. Bigham, Crowd Memory: Learning in the Collective, In Proceedings of Collective Intelligence (CI 2012), Boston, MA, 2012

Walter S. Lasecki, Jeffrey P. Bigham, Self-Correcting Crowds, In Proceedings of the ACM Conference on Human Factors in Computing Systems Work-in-Progress (CHI 2012), Austin, TX, 2012

Yu Zhong, Phyo Thiha, Grant He, Walter S. Lasecki, Jeffrey P. Bigham, Using Real-time Feedback to Improve Visual Question Answering, In Proceedings of the ACM Conference on Human Factors in Computing Systems Work-in-Progress (CHI 2012), Austin, TX, 2012

Adam Sadilek, Henry Kautz, Jeffrey P. Bigham, Finding Your Friends and Following Them To Where You Are, In Proceedings of the ACM Conference on Web Search and Data Mining (WSDM 2012), Seattle, WA, 2012. * Best Paper Award

2011

Jeffrey P. Bigham, Richard E. Ladner, Yevgen Borodin, The Design of Human-Powered Access Technology, In Proceedings of the ACM Conference on Computers and Accessibility (ASSETS 2011), Dundee, Scotland, 2011

Chandrika Jayant, Hanjie Ji, Samuel White, Jeffrey P. Bigham, Supporting Blind Photography, In Proceedings of the ACM Conference on Computers and Accessibility (ASSETS 2011), Dundee, Scotland, 2011

Walter S. Lasecki, Kyle I. Murray, Samuel White, Robert C. Miller, Jeffrey P. Bigham, Real-time Crowd Control of Existing Interfaces, In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2011), Santa Barbara, CA, 2011

Kyle I. Murray, Jeffrey P. Bigham, Beyond Autocomplete: Automatic Function Definition, In Proceedings of the 2011 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC 2011), Pittsburgh, PA, 2011

Jeffrey P. Bigham, Richard E. Ladner, What the disability community can teach us about interactive crowdsourcing, In Interactions Magazine (Interactions 2011), New York, New York, 2011

Naushad UzZaman, Jeffrey P. Bigham, James F. Allen, Multimodal Summarization of Complex Sentences, In Proceedings of the International Conference on Intelligent User Interfaces (IUI 2011), Palo Alto, CA, 2011

2010

Jeffrey P. Bigham, Bernie Zhang, Jeremy Brudvik, Accessibility by Demonstration: Enabling End Users to Guide Developers to Web Accessibility Solutions, In Proceedings of the 12th International Conference on Computers and Accessibility (ASSETS 2010), Orlando, Florida, 2010

Samuel White, AudioWiz: Nearly Real-time Audio Transcriptions, In Proceedings of the 12th International Conference on Computers and Accessibility – Student Research Competition (ASSETS 2010), Orlando, Florida, 2010. * ACM Student Research Competition Winner

Kyle I. Murray, FlashDOM: Interacting with Flash Content from the Document Object Model, In Proceedings of the 12th International Conference on Computers and Accessibility – Student Research Competition (ASSETS 2010), Orlando, Florida, 2010

Jeffrey P. Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C. Miller, Robin Miller, Aubrey Tatrowicz, Brandyn White, Samuel White, Tom Yeh, VizWiz: Nearly Real-time Answers to Visual Questions, In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2010), New York, New York, 2010. * Best Paper Award

Tessa Lau, Julian A. Cerruti, Guillermo Manzato, Mateo Bengualid, Jeffrey P. Bigham and Jeffrey W. Nichols, A Conversational Interface to Web Automation, In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2010), New York, New York, 2010

Samuel White, Hanjie Ji, Jeffrey P. Bigham, EasySnap: Real-time Audio Feedback for Blind Photography, In Proceedings of the ACM Symposium on User Interface Software and Technology – Demos Track (UIST 2010), New York, New York, 2010

Jeffrey P. Bigham, Kyle Murray, WebTrax: Visualizing Non-Visual Web Interactions, In Proceedings of the International Conference on Computers Helping People (ICCHP 2010), Vienna, Austria, 2010

Jeffrey P. Bigham, Chandrika Jayant, Andrew Miller, Brandyn Whit, Tom Yeh, VizWiz::LocateIt – Enabling Blind People to Locate Objects in their Environment, In Proceedings of the Workshop on Computer Vision Applications for the Visually Impaired (CVAVI 2010), San Francisco, California, 2010

Yevgen Borodin, Gleen Dausch, Jeffrey P. Bigham, I.V. Ramakrishnan, More than Meets the Eye: A Survey of Screen-Reader Browsing Strategies, In Proceedings of the International Cross-Disciplinary Conference on Web Accessibiliy (W4A 2010), Raleigh, North Carolina, 2010

Jeffrey P. Bigham, Wendy Chisholm, Richard E. Ladner, WebAnywhere – Experiences with a New Delivery Model for Access Technology, In Proceedings of the International Cross-Disciplinary Conference on Web Accessibiliy (W4A 2010), Raleigh, North Carolina, 2010

Anna C. Cavender, Daniel Otero, Jeffrey P. Bigham, Richard E. Ladner, ASL-STEM Forum: Enabling Sign Language to Grow Through Online Collaboration, In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2010), Atlanta, Georgia, 2010

2009

Anna C. Cavender, Jeffrey P. Bigham, Richard E. Ladner, ClassInFocus: Enabling Improved Visual Attention Strategies for Deaf and Hard of Hearing Students, In Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2009), Pittsburgh, Pennsylvania, USA, 2009. * Best Student Technical Paper

Jeffrey P. Bigham, Ryan Kaminsky, Jeffrey Nichols, Mining Web Interactions to Automatically Create MashUps, In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2009), Victoria, British Columbia, Canada, 2009