QoE Assessment of Group Synchronization Control Scheme with Prediction in Work Using Haptic Media

Pingguo Huang, Yutaka Ishibashi, Norishige Fukushima, Shinji Sugawara

Department of Scientific and Engineering Simulation, Nagoya Institute of Technology, Nagoya, Japan.

DOI: 10.4236/ijcns.2012.56042                

Abstract

This paper proposes a group synchronization control scheme with prediction in work using haptic media. The scheme adjusts the output timing among multiple terminals and keeps the interactivity high. It outputs position information by predicting the future position later than the position included in the last-received information by a fixed amount of time. It also advances the output time of position information at each local terminal by the same amount of time. We deal with two different types of work using haptic media so as to demonstrate the effectiveness of the scheme. We assess the output quality of haptic media for the two types of work subjectively and objectively by Quality of Experience (QoE) assessment. We further clarify the relationship between subjective and objective assessment results.

Keywords

Group Synchronization Control; Prediction Control; Haptic Media; Remote Drawing Instruction; Play with Building Blocks; Collaborative Work; QoE; Assessment

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	M. A. Srinivasan and C. Basdogan, “Haptics in Virtual Environments: Taxonomy, Research Status, and Challenges,” Computers and Graphics, Vol. 21, No. 4, 1997, pp. 393-404. doi:10.1016/S0097-8493(97)00030-7
[2]	I. Lee and S. Choi, “Discrimination of Visual and Haptic Rendering Delays in networked Environments,” International Journal of Control, Automation and Systems, Vol. 7, No. 1, 2009, pp. 25-31. doi:10.1007/s12555-009-0104-0
[3]	Y. You, M. Sung, N. Kim and K. Jun, “An Experimental Study on the Performance of Haptic Data Transmission in Networked Haptic Collaboration,” Proceedings of the 9th International Conference on Advanced Communication Technology, Phoenix Park, 12-14 February 2007, pp. 657-662.
[4]	J. Kim, H. Kim, B. K. Tay, M. Muniyandi, M. A. Srinivasan, J. Jordan, J. Mortensen, M. Oliveira and M. Slater, “Transatlantic Touch: A Study of Haptic Collaboration over Long Distance,” Presence, Vol. 13, No. 3, 2004, pp. 328-337. doi:10.1162/1054746041422370
[5]	C. Gunn, M. Hutchins and M. Adcok, “Combating Latency in Haptic Collaborative Virtual Environments,” Presence, Vol. 14, No. 3, 2005, pp. 313-328. doi:10.1162/105474605323384663
[6]	M. Y. Sung, Y. Yoo, K. Jun, N. Kim and J. Chae, “Experiments for a Collaborative Haptic Virtual Reality,” Proceedings of the 16th International Conference on Artificial Reality and Telexistence, Hangzhou, 29 November-1 December 2006, pp. 174-179.
[7]	ITU-T Rec. P. 10/G. 100 Amendment 1, “New Appendix I—Definition of Quality of Experience (QoE),” International Telecommunication Union, 2007.
[8]	S. Lee, S. Moon and J. Kim, “Performance Evaluation of Transport Protocols for Networked Haptic Collaboration,” Proceedings of SPIE Optics East Multimedia Systems and Applications IX, Boston, 1-4 October 2006.
[9]	M. Glencross, C. Jay, J. Feasel, L. Kohli and M. Whitton, “Effective Cooperative Haptic Interaction over the Internet,” Proceedings of IEEE Virtual Reality, Charlotte, 10-14 March 2007, pp. 115-122.
[10]	I. Arimoto, K. Hikichi, K. Sezaki and Y. Yasuda, “Influence of Network Delay on Ensemble Application,” Proceedings of IEEE International Workshop on Haptic Audio Visual Environments and Their Applications, Ottawa, 1-2 October 2005, pp. 19-22.
[11]	Y. Ishibashi and H. Kaneoka, “Fairness among Game Player in Networked Haptic Environments: Influence of Network Latency,” Proceedings of the IEEE International Conference on Multimedia and Expo, Amsterdam, 6-9 July 2005.
[12]	K. Hikichi, H. Morino, I. Arimoto, I. Fukuda, S. Matsumoto, M. Iijima, K. Sezaki and Y. Yasuda, “Architecture of Haptics Communication System for Adaptation to Network Environments,” Proceedings of the IEEE International Conference on Multimedia and Expo, Tokyo, 22-25 August 2001.
[13]	H. Kaneoka and Y. Ishibashi, “Effects of Group Synchronization Control over Haptic Media in Collaborative Work,” Proceedings of the 14th International Conference on Artificial Reality and Telexistence, Seoul, 30 November-2 December 2004, pp. 138-145.
[14]	Y. Ishibashi, T. Hasegawa and S. Tasaka, “Group Synchronization Control for Haptic Media in Networked Virtual Environments,” Proceedings of the 12th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, Chicago, 27-28 March 2004, pp. 106-113.
[15]	T. Hashimoto and Y. Ishibashi, “Group Synchronization Control over Haptic Media in a Networked Real-Time Game with Collaborative Work,” Proceedings of ACM NetGames, Singapore, 30-31 October 2006.
[16]	Y. Kurokawa, Y. Ishibashi and T. Asano, “Group Synchronization Control in a Remote Haptic Drawing System,” Proceedings of the IEEE International Conference on Multimedia and Expo, Beinjing, 2-5 July 2007, pp. 572-575.
[17]	Y. Tsumaki and M. Yokohama, “Predictive Motion Display for Acceleration Based Teleoperation,” Proceedings of the IEEE International Conference on Robotics and Automation, Orlando, 15-19 May 2006, pp. 2927-2932.
[18]	T. Asano, Y. Ishibashi and S. Kameyama, “Interactive Haptic Transmission for Remote Control Systems,” Proceedings of the IEEE International Conference on Multi-media and Expo, Toronto, 9-12 July 2006, pp. 2113-2116.
[19]	P. Huang, Y. Ishibashi, N. Fukushima and S. Sugawara, “Collaborative Haptic Play with Building Blocks,” Proceedings of the International Conference on Advances in Computer Enterntainment Technology, Athens, 29-31 October 2009.
[20]	P. Briiks and B. Hestnes, “User Measures of Quality of Experience: Why Being Objective and Quantitative Is Important,” IEEE Network, Vol. 24, No. 2, 2010, pp. 8-13. doi:10.1109/MNET.2010.5430138
[21]	J. K. Salisbury and M. A. Srinivasan, “Phantom-Based Haptic Interaction with Virtual Objects,” IEEE Computer Graphics and Applications, Vol. 17, No. 5, 1997, pp. 6-10. doi:10.1109/MCG.1997.1626171
[22]	SensAble Technologies, Inc., “3D Touch SDK OpenHaptics Toolkit Programmer’s Guide,” Version 1.0, 2004.
[23]	P. Huang, Y. Ishibashi, N. Fukushima and S. Sugawara, “Interactivity Improvement of Group Synchronization Control in Collaborative Haptic Play with Building Blocks,” Proceedings of ACM NetGames, Taipei, 16-17 November 2010.
[24]	Y. Ishibashi and S. Tasaka, “A Distributed Control Scheme for Group Synchronization in Multicast Communications,” Proceedings of ISCOM, Kaohsiung, November 1999, pp. 317-323.
[25]	Y. Kurokawa, Y. Ishibashi and T. Asano, “An Experiment on Inter-Destination Synchronization Control in a Remote Drawing Instruction System Using Haptic Media: Subjective Assessment and Objective Assessment,” IEICE Technical Report, CQ2006-79, 2007.
[26]	Y. Ishibashi and S. Tasak, “A Group Synchronization Mechanism for Live Media in Multicast Communications,” IEEE Global Telecommunications Conference, Phoenix, 3-8 November 1997, pp. 746-752.
[27]	Y. Ishibashi, S. Tasaka and T. Hasegawa, “The Virtual-Time Rendering Algorithm for Haptic Media Synchronization in Networked Virtual Environments,” Proceedings of IEEE International Workshop on Communications Quality and Reliability (CQR), Okinawa, 14-16 May 2002, pp. 213-317.
[28]	S. K. Singhal and D. R. Cheritton, “Using a Position History-Based Protocol for Distributed Object Visualization,” Technical Report, Stanford University, Department of Computer Science, 1994.
[29]	M. Carson and D. Santay, “NIST Net—A Linux-Based Network Emulation Tool,” ACM SIGCOMM Computer Communication Review, Vol. 33, No. 3, 2003, pp. 111-126. doi:10.1145/956993.957007
[30]	ITU-R BT. 500-11, “Methodology for the Subjective Assessment of the Quality of Television Pictures,” International Telecommunication Union, 2002.
[31]	G. W. Snedecor and W. G. Cochran, “Statistical Methods,” 7th Edition, The Iowa State University Press, Ames, 1980.
[32]	T. Asano, S. Kameyama and Y. Ishibashi, “Subjective Assessment of Output Quality of Haptic Media in a Remote Control System Using Haptic Interface Devices,” IEICE Technical Report, CQ2005-66, 2005.
[33]	S. Chatterjee, A. S. Hadi and B. Price, “Regression Analysis by Example,” John Wiley & Sons, Hoboken, 1999.
[34]	H. Mizuno, Y. Ishibashi and S. Sugawara, “A Comparison between Transmission Methods of Sense of Force in a Remote Haptic Instruction System,” Proceedings of IEEE International Conference on Multimedia and Expo, New York, 28 June-2 July 2009, pp. 1202-1205.
[35]	G. Welch and G. Bishop, “An Introduction to the Kalman Filter,” Notes of ACM SIGGRAPH Tutorial on the Kalman Filter, The University of North Carolina at Chapel Hill, Chapel Hill, 2001.