This paper is concerned with constructing a prototype intelligent home environment for home service robot. In this environment, multi-pattern information can be represented by some intelligent artificial marks. Light-packs service robots can provide reliable and intelligent service by interacting with the environment through the wireless sensor networks. The intelligent space consists the following main components: smart devices with intelligent artificial mark; home server that connects the smart device and maintains the information through wireless sensor network; and the service robot that perform tasks in collaboration with the environment. In this paper, the multi-pattern information model is built, the construction of wireless sensor networks is presented, the smart and agilely home service is introduced. Fi- nally, the future direction of intelligent space system is discussed.
As the aging problem becomes increasingly serious in many countries and in order to improve the life quality of eldly persons and persons with physical disabilities, the development to home service robot and the study of practical technology of home service robot are very important (as discussed by Tian Guohui [
It is necessary for robots to enter the home and provide service for human (as discussed by Seung-Ho Baeg [
Intelligent space technology is a new research field (as discussed as Joo-Ho Lee [
The key idea of the intelligent space oriented to home service robot (Intelligent home environment) is the family environment is installed many types of sensors and actuators to establish an artificial home service environment where human and robots coexist. The intelligent space can percept the changing of the objects through wireless sensor network, transfer information with robot by network, record, track and manage the objects in intelligent space. Combining with the intelligent space technology, without adding more sensors on home service robot, a service robot can obtain more comprehendsive environmental information, perceive human and objects in space more completely.
With this method, robot can do more service tasks and do them better with “light packs” in a complex home environment, for example, robot can complete many tasks which can’t be solved depending on its onboard sensors. At same time, intelligent space can be used as a common platform for multi-service robot systems. Multiunit and multi-type service robots can work in the same platform with “light packs”, share the information resources (as discussed by Tian Guohui [
In this paper, the structure of the intelligent space oriented to home service robot is introduced in Section 2, a new multi-pattern information model are proposed in Section 3, in Section 4, a construction of wireless sensor networks in intelligent space is introduced, the smart and agilely home service provided by home service robot based on the multi-pattern information and wireless sensor network is introduced detailed in Section 5. Finally a discussion and the conclusion are presented in the last section.
An intelligent home is a residence in which computing and information technology apply to expect and respond to the occupants’ needs and can be used to enhance the everyday life at home. The architecture of an intelligent space is shown as
Our intelligent home environment system mainly consists of three components: smart objects; home server and service robot. Smart objects are the basic elements of the intelligent space. They are objects with artificial land mark or objects with either sensor capabilities or actuator capabilities or both. They can communicate with the home server through wireless networks. Home server manages smart objects, collects data in the intelligent space, makes decisions based on the collected data and controls the smart objects. Service robot provides reliable service by symbiotic interactions with the environment through the wireless communication networks. Suppose robot needs to turn on the TV in the intelligent home for some reason, in the traditional robot platform, the robot should calculate the position of the TV switch through vision processing and object recognition system while moving to the TV, then move its arm to touch the switch. In our intelligent home environment, what the robot need to know is the network address of the TV. Some complex tasks can be finished easily and satisfied.
There exit two important research fields in the study to intelligent home environment. The first one is information model representation and multi-pattern acquisition, the second is the wireless sensor networks. Robot can obtain more and high level information with the help of these two technologies, can understand and perceive the environment more completely.
In order to complete tasks, it is better for robot to obtain more and more environment information. In the traditional research to robot, the main method for robot to get the environment information is by the “eyes” of the robot: camera and sensors. After complex algorithm and computation, these information can be understood by robot. Usually, the information obtained by this way is limited and lower level, this will effect the quality of the task implementation for robot, especially in complicated and unstructured environment. In intelligent space, artificial marks are adopted to build information representation model, such as landmark and object mark (as discussed elsewhere [6-8]). These low-cost information mediums are an effective supplement to the information network in intelligent space system. Robot can get more and highlevel information through the information network in intelligent space without equipping more expensive sensors, these high-level information usually can’t be obtained by traditional pattern.
QR Code (Quick Response code) and RFID (Radio Frequency Identification) technologies are used to design the artificial landmarks and object marks in our intelligent home environment, which construct a complete information network and become the foundation for multipattern information acquisition.
1) QR Code Information Representation Model The artificial landmarks which is designed should have the following characteristics: can be detected, can be identified and can be positioned.
The artificial landmark designed in our system includes two parts: outside circle and inner information representation, shown in
The new artificial landmark we designed is a real twodimensional landmark, because the outside circle and QR Code are all two-dimensional. Compared with one-dimensional landmark, the two-dimensional landmark can be read from any direction and can provide more information.
In
2) RFID Information Representation Model RFID system mainly includes three parts: antenna, reader, and RFID tag. Because of the uniqueness of the RFID tag, the reader can locate and track the target once it is attached on an RFID tag. In our system, we use 900MHz RFID product made by Shenzhen Javs Technology Corporation, as shown in
3 (on left) because they are much cheaper, long lived, lightweight and have a smaller foot print. The reader as shown in
RFID has the following advantages: noncontactable, identify multi-target at the same time, high speed and far distance, etc. The combination of RFID and QR Code can build the information network, provide more and high level information of the environment to the robot (as discussed by Yinghua Xue [
Define abbreviations and acronyms the first time they are used in the text, even after they have been defined in the abstract. Abbreviations such as IEEE, SI, MKS, CGS, sc, dc, and rms do not have to be defined. Do not use abbreviations in the title or heads unless they are unavoidable.
An intelligent home environment is a physical world where smart items, sensors and actuators are placed and they are invisibly and seamlessly interwoven through a continuous network. These equipment can percept the environment information or represent the environment information to the robot. In order to obtain more accuracy and more comprehensive environment information, robot must fuse all types of information provided by intelligent space, usually these information are incomplete and uncertain. The information in intelligent space can be divided into 3 levels: data level, feature level and decision level. With the help of computation ability in intelligent space, deeper information can be acquired through the data fusion to multi-pattern information (as discussed elsewhere [18,19]). Data fusion is the foundation for the intelligent space and robot to provide intelligent and autonomous service to people. The structure of data fusion in our intelligent space system is shown as
The information of data level mainly come from the sensors in the intelligent space and the sensors on robot, such as temperature, humility. Data of feature level include time, date, address, people, etc. In process of data fusion, different algorithm can be adopted according to the data feature. For example, in the first example in Section 5, robot can get different information from the QR code, RFID and the sensors equipped on its board. We can adopt some algorithm to fuse the information, so the robot can decide the path to access the object and the way to catch the object. The result of data fusion is to make a decision to control the devices, to understand the people behavior, to provide intelligent service.
In intelligent space, intelligent devices, such as sensors, artificial landmark, camera can provide many environment information. In order to realize the interaction with intelligent space, these information must be seamlessly interconnected and be transferred. One of the core technologies for studying intelligent space is communications technologies which connects devices with the environment. With the help of communication technologies, all kinds of information can be transferred among the intelligent device. The realization of information communication depends on network. In order to share these information, ZigBee, Wi-Fi and TCP/IP protocols are adopted to built a heterogeneous network in intelligent space system. This network becomes a bridge of information exchange. Service robot, distributed intelligent nodes and smart devices communicated with server through wireless or wired network. The heterogeneous network in intelligent space system is shown in
In the model of heterogeneous network in intelligent space, different network is assigned to different tasks. Wi-Fi is used to transfer video and control command between server and robot. TCP/IP is used to transfer the video from distributed network camera. The purpose of GPRS is to transfer the information to mobile, PDA (Personal Digital Assistant).
In the inner network, the ZigBee protocol is adopted in to built wireless sensor and actor network in intelligent space. ZigBee is a new wireless communication technology based on wireless standard 802.15.4 (as discussed elsewhere [20-24]).Compared with other protocol standards, ZigBee technology has the following advantages: 1) short range 2) low-power 3) low transmission rate 4) large Network capacity 5) the network is very strong in self-grouping 6) short delay. In our intelligent space system, Zigbee is used to transfer the environmental sensor data, such as temperature, humidity, it also can transfer the control command to the intelligent device to realize the intelligence of the home.
The transformation of sensor information and control information which cover more range can be achieved in intelligent space through the building of wireless sensor network. It extends the working scope of intelligent space and home service robot.
Robot can provide smart and agilely home service with the interaction with intelligent space environment. In this paper, we select 2 examples to introduce.
One of the main tasks of service robot is to provide different kinds of services to persons in complex indoor environment, such as delivering water or medicine. So the robot must have the ability to search the target and recognize the target autonomously. Computer vision is widely used in the field of object recognition (as discussed elsewhere [25-28]). But in complex indoor environment, there are many difficulties to recognize the object through vision [
Another important task for service robot is to detect the elderly abnormal behavior and provide help. In our intelligent space system, when abnormal behavior, such as fall suddenly is detected, robot should move to the elderly. Abnormal detection and help system based on ZigBee wireless sensor networks is shown in
The ceiling projector is used for robot navigation in intelligent space. In intelligent space, the information is gathered and integrated to plan a reasonable path for the mobile robot. The path data are sent to the controller of the ceiling projector through ZigBee wireless sensor networks, which casts a spot along the path. Then, the mobile robot follows the moving spot by using its on-
board sensors (e.g. CCD camera). This navigation method reduces the sensors for navigation carried on mobile robot. The path data are transmitted using our ZigBee wireless sensor networks.
The ceiling projector consists of a pan-tilt and a laser projector installed at the end effect, which is shown in
Further, we can get the Jacobian matrix representing the joint speed and the spot velocity as,
where, represents the Jacobian matrix, is the coordinate in. The input of the system is the velocity of spot in base coordinate as shown in
In this paper, the intelligent home environment based on multi-pattern information and Zigbee wireless sensor networks is introduced. With the interaction with the intelligent space, service robot can obtain more comprehensive environmental information without adding more sensors on service robot. In the intelligent space, robot can work with “light packs” and the service quality can be improved. But there should require further research about the multi-pattern information model, such as the optimization set of the artificial land marks. In additional, the algorithm of data fusion is an important research topic to improve the accuracy of decision-making.
The authors gratefully acknowledge the funds provided by National Natural Science Foundation of China under Grant 61075092,National High-tech Program of China (863 Program) under Grant 2009AA04Z220, Natural
Science Foundation of Shandong Province under Grant ZR2011FM011 and Self-determined and innovation foundation of Shandong University under Grant 2011JC017.