A Method of Combination of Language Understanding with Touch-Based Communication Robots

Takuki Ogawa, Hiroaki Bando, Kazuhiro Morita, Masao Fuketa, Jun-Ichi Aoe

University of Tokushima, Tokushima City, Japan.

DOI: 10.4236/ijis.2012.24010                

Abstract

Studies of robots which aim to entertain and to be conversational partners of the live-alone become very important. The robots are classified into DBC (Dialogue-Based Communication) robots and TBC (Touch-Based Communication) robots. DBC robots have an effect to be conversational partners. A typical application of TBC robots is Paro (a baby harp seal robot) which has an effect to entertain humans. The combination of DBC and TBC will be able to achieve both a conversational ability and an entertaining effect, but there is no study of combination of DBC and TBC. This paper proposes a response algorithm that can combine conversational information and touch information from humans. Criterions for estimation are defined as follows: FFV (Familiarity Factor Value), EFV (Enjoyment Factor Value), CR (Concentration Rate), ER (Expression Rate), and RR (Recognition Rate). FFV and EFV are total ratings for questionnaire related to familiarity and enjoyment factors, respectively. CR measures attention for humans. ER is the interest of communication with robots by representing Level 2 (laugh with opening one’s mouse), Level 1 (smile), and Level 0 (expressionless). RR is recognition ability for voices and touch actions. From the experiment for impressions of robot responses with 11 subjects, it turns out that the proposed method with combination of DBC and TBC is improved by 20.7 points in FFV, and by 12.6 points in EFV compared to only TBC. From the robot communication experiment, it turns out that the proposed method is improved by 8 points in the ER, by 5.3 points in the ER with Level 2, and by 24.5 points in the RR compared to only DBC.

Keywords

Natural Language Interface; Robot Communication; Touch-Based Dialogue; Empathetic Responses

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	Y. Nakano, J. Hikino and K. Yasuda, “Conversational Agents for Dementia: A Field Study for A Prototype System,” The 25th Annual Conference of the Japanese Society for Artificial Intelligence, Morioka, 1-3 June 2011, pp. 1-4.
[2]	H. Kozima, C. Nakagawa and Y. Yasuda, “Interactive Robots for Communication-Care: A Case-Study in Autism Therapy,” IEEE International Workshop on Robots and Human Interactive Communication, Nashiville, 13-15 August 2005, pp. 341-346. doi:10.1109/ROMAN.2005.1513802
[3]	N. Mitsunaga, T. Miyashita, H. Ishiguro, K. Kogure and N. Hagita, “Robovie-IV: A Communication Robot Interacting with People Daily in an Office,” Intelligent Robots and Systems 2006 IEEERSJ International Conference, Beijing, 9-15 October 2006, pp. 5066-5072.
[4]	K. Wada, T. Shibata, T. Asada and T. Musha, “Robot Therapy for Prevention of Dementia at Home—Results of Preliminary Experiment,” Journal of Robotics and Mechatronics, Vol. 19, No. 6, 2007, pp. 691-697.
[5]	M. Fujita, “On Activating Human Communications with Pet-Type Robot AIBO,” IEEE Proceedings, Vol. 92, No. 11, 2004, pp. 1804-1813.
[6]	M. P. Bacigalupo, C. Mennecozzi and T. Shibata, “Socially Assistive Robotics in the Treatment of Behavioral and Psychological Symptoms of Dementia,” 2006 First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, Pisa, 20-22 February 2006, pp. 483-488.
[7]	T. Shibata, “An Overview of Human Interactive Robots for Psychological Enrichment,” Proceedings of the IEEE, Vol. 92, No. 11, 2002, pp. 1749-1758.
[8]	M. Kanoh, Y. Oida, T. Shimizu, T. Kishi, K. Ihara and M. Shimizu, “Some Facts Revealed from an Elderly and Babyloid Symbiosis,” The 25th Annual Conference of the Japanese Society for Artificial Intelligence, Morioka, 1-3 June 2011, pp. 1-3.
[9]	N. Futoshi, S. Kazuhiro and K. Kiyoshi, “Human-Robot Tactile Interaction,” Information Proceeding Society of Japan, Vol. 44, No. 12, 2003, pp. 1227-1232.
[10]	N. Futoshi, S. Kazuhiro, Y. Junji and K. Kiyoshi, “Real-Time Classification of Human Touching Behaviors Using Pressure Sensors and Its Personal Adaptation,” The Institute of Electronics, Information and Communication Engineers, 2002, pp. 613-621.
[11]	T. Ogawa, K. Morita, H. Kitagawa, M. Fuketa and J. Aoe, “A Study of Dialogue Robot with Haptic Interactions,” 7th International Conference on Natural Language Processing and Knowledge Engineering, Tokushima, 27-29 November 2011, pp. 285-288.
[12]	T. Ogawa, K. Morita, M. Fuketa and J. Aoe, “Empathic Robot Communication by Touch-Based Dialog Interfaces,” Proceedings of Sixth International Knowledge Management in Organizations Conference, Tokyo, 27-28 September 2011.
[13]	R. Freedman, “Using a Reactive Planner as the Basis for a Dialogue Agent,” Proceedings of FLAIRS 2000, Orlando, 22-24 May 2000, pp. 203-208.
[14]	B. S. Lin, H. M. Wang and L. S. Lee, “A Distributed Agent Architecture for Intelligent Multi-Domain Spoken Dialogue Systems,” IEICE Transactions on Information and Systems, Vol. E84-D, No. 9, 2001, pp. 1217-1230.
[15]	N. Alm, R. Dye, G. Gowans and J. Cambell, “A Communication Support System for Older People with Dementia,” IEEE Computer, Vol. 40, No. 5, 2007, pp. 35-41. doi:10.1109/MC.2007.153
[16]	A. J. Astell, M. P. Ellis, L. Bernardi, N. Alm, R. Dye, G. Gownas and J. Campebell, “Using a Touch Screen Computer to Support Relationships between People with Dementia and Caregivers,” Interaction with Computers, Vol. 22, No. 4, 2010, pp. 267-275. doi:10.1016/j.intcom.2010.03.003
[17]	T. Meguro, R. Higashinaka, K. Dohsaka, Y. Minami and H. Isozaki, “Analysis of Listening-Oriented Dialogue for Building Listening Agents,” Proceeding SIGDIAL 09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Stroudsburg, 2009, pp. 124-127.
[18]	T. Shibata, “Mental Commit Robot for Healing Human Mind,” The Robotics Society of Japan, Vol. 17, No. 7, 1999, pp. 943-946. doi:10.7210/jrsj.17.943
[19]	K. Wada, T. Shibata, T. Saito and K. Tanie, “Effects of Robot-Assisted Activity for Elderly People and Nurses at a Day Service Center,” Proceedings of the IEEE, Vol. 92, No. 11, 2004, pp. 1780-1788. doi:10.1109/JPROC.2004.835378
[20]	A. Corradini and P. R. Cohen, “On the Relationships among Speech, Gestures, and Object Manipulation in Virtual Environments: Initial Evidence,” In 2002 CLASS Workshop on Natural, Intelligent, and Effective Interaction in Multimodal Dialog Systems, Denmark, 28-29 June 2002.
[21]	T. Kanda, H. Ishiguro and T. Ishida, “Psychological Analysis on Human-Robot Interaction,” Proceedings of the 2001 IEEE International Conference on Robotics and Automation, Vol. 4, 2001, pp. 4166-4173.
[22]	The Press Release of Research Institute National Rehabilitation Center for Persons with Disablilities, “Developed a Robot which Provide Information to Support Independence Action of Persons with Dementia,” 2010. http://www.rehab.go.jp/hodo/japanese/news_22/news22-03.html
[23]	H. Kuma, “Quantitative Evaluation for ‘Laugh’ Using a Hobby Robot in Care of Aged Facilities,” The Shinshu Branch of JSLHS, Vol. 17, 2010, pp. 50-60.