Prototyping and Evaluating a Wearable System for Mobile Distributed Collaboration

Weidong Huang, Leila Alem, Jalal Albasri

CSIRO, Marsfield, NSW, Australia.

DOI: 10.4236/cn.2013.53B2100                

Abstract

We have developed a wearable system for mobile distributed collaboration called HandsInAir using emerging wireless and mobile technologies. This system was developed to support real world scenarios in which a remote mobile helper guides a local mobile worker in the completion of a physical task. HandsInAir consists of a helper unit and a worker unit. Both units are equipped with wearable devices having the same hardware configuration, but running different pieces of software to support the distinct roles of the collaborators (helper and worker). The two sides are connected via a wireless network and the collaboration partners can communicate with each other via audio and visual links. In this paper we describe the technical implementation of the system and present a preliminary evaluation of it. The paper concludes with a brief discussion of possible future work for further improvements and new developments.

Keywords

Wireless Network; Mobile Computing; Remote Collaboration; Video Mediated Communication; Remote Gestures

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	H. H. Clark and S. E. Brennan, “Grounding in Communication,” Perspectives on Socially Shared Cognition. American Psychological Association, Washington DC, 1991. http://dx.doi.org/10.1037/10096-006
[2]	S. R. Fussell, R. E. Kraut and J. Siegel, “Coordination of Communication: Effects of Shared Visual Context on Collaborative Work,” ACM Conference on Computer Supported Cooperative Work, 2000, pp. 21-30.
[3]	D. S. Kirk, T. Rodden and D. S. Fraser, “Turn It This Way: Grounding Collaborative Action with Remote Gestures,” ACM Human Factors in Computing Systems, 2007, pp. 1039-1048.
[4]	L. Alem, F. Tecchia and W. Huang, “HandsOnVideo: Towards a Gesture Based Mobile AR System for Remote Collaboration,” Recent Trends of Mobile Collaborative Augmented Reality, Springer, New York, 2011, pp. 127- 138.
[5]	S. R. Fussell, L. D. Setlock, J. Yang, J. Ou, E. Mauer and A. D. I. Kramer, “Gestures over Video Streams to Support Remote Collaboration on Physical Tasks,” Human-Computer Interaction, Vol. 19, 2004, pp. 273-309. http://dx.doi.org/10.1207/s15327051hci1903_3
[6]	S. Gauglitz, C. Lee, M. Turk and T. Höllerer, “Integrating the Physical Environment into Mobile Remote Collaboration,” Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services, 2012, pp. 241-250.
[7]	H. Kuzuoka, “Spatial Workspace Collaboration: A Shared View Video Support System for Remote Collaboration Capability,” ACM Human Factors in Computing Systems, 1992, pp. 533-540.
[8]	W. Huang and L. Alem, “HandsinAir: A Wearable System for Remote Collaboration on Physical Tasks,” Proceedings of the 2013 Conference on Computer Supported Cooperative Work Companion, 2013, pp. 153-156.
[9]	W. Huang and L. Alem, “Gesturing in the Air: Supporting Full Mobility in Remote Collaboration on Physical Tasks,” Journal of Universal Computer Science, 2013.
[10]	OpenCV. http://opencv.willowgarage.com/wiki/
[11]	Libjpeg-Turbo. http://libjpeg-turbo.virtualgl.org/
[12]	Independent JPEG Group. Available: http://www.ijg.org/
[13]	Windows Sockets 2. http://msdn.microsoft.com/en-us/library/ms740673(v=vs.85).aspx
[14]	Microsoft Foundation Classes. http://msdn.microsoft.com/en-us/library/d06h2x6e(v=VS.100).aspx
[15]	Multithreaded Programming with the Event-based Asynchronous Pattern. http://msdn.microsoft.com/en-us/library/hkasytyf.aspx
[16]	Critical Section Objects. http://msdn.microsoft.com/en-us/library/ms682530(VS.85).aspx.
[17]	F. Dadgostar and A. Sarrafzadeh, “An adaptive real-time skin detector based on Hue thresholding: A comparison on two motion tracking methods,” Pattern Recognition Letters, Vol. 27, No. 12, 2006, pp. 1342-1352. http://dx.doi.org/10.1016/j.patrec.2006.01.007
[18]	W. Huang and L. Alem, “Supporting Hand Gestures in Mobile Remote Collaboration: A Usability Evaluation,” Proceedings of the 25th BCS Conference on Human Computer Interaction, 2011, pp. 211-216.
[19]	F. Tecchia, L. Alem and W. Huang, “3D Helping Hands: A Gesture Based MR System for Remote Collaboration,” Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry, 2012, pp. 323-328.
[20]	W. Huang, L. Alem and F. Tecchia, “HandsIn3D: Supporting Remote Guidance with Immersive Virtual Environments,” Proceedings of the 14th IFIP TC13 Conference on Human-Computer Interaction, 2013, pp. 70-77.