Investigating Efficacy of “ Working Memory Training Software ” on Students Working Memory

The aim of the present study is developing “Working Memory Training Software”, and investigating its content validity and the efficacy of this computerized cognitive training on students working memory. This study is in R & D research category, and it is performed in a semi-experimental design. Its data were collected from students of the third grade (30), fourth grade (30), and fifth grade (12) of primary school. After specifying the software content validity by asking expertise opinions, and investigating these opinions through Spearman Test (rs = 1), these children attended in intervention program for 10 sessions. The subtests of working memory in “Tehran-Stanford-Binet Intelligence Scale” and “Wechsler intelligence scale for children” were conducted in all three groups on the pre-test and post-test. After elimination of the pre-test effect, Paired-Samples T-Test on total scores of subtests of working memory in “Tehran-Stanford Binet Intelligence Scale” (t = 10.869, df = 71, r = 0.967 & P < 0.05) and in “Wechsler intelligence scale for children” (t = 16.809, df = 71, r = 0.983 & P < 0.05) reveals a significant difference in post-test scores. Based on this study the Working Memory Training Software has proper psychometric properties and causes significant improvement in students working memory performance.


Introduction
Today educational psychology considers that learning mostly requires efficient use of working memory (WM).
Our working memory has the ability to remember information, and to process or manage information.It also has a fundamental role in a wide range of complex educational activities such as reading comprehension, calculations, and problems associated with words and simple tasks such as transcription from board and orientation [1].Working memory is the basic of learning and basic cognitive skills that determines our potential for learning.Even according to some experts, it is more important than intelligence quotient [1].
The important component of executive function is working memory [2] that helps human through life, doing tasks, learning, and intellectual activities [3].Also a wide range of cognitive abilities, especially engaging with information interference and conflict or distraction are influenced by working memory.Therefore cognitive abilities are essential and predict academic achievement in children [2].
Working memory was first introduced by Baddeley and Hitch (1974).They argued that the concept of working memory must be replaced by the concept of short-term memory [4].According to Baddeley (2001) and Repovs & Baddeley (2006), working memory has four components of the central executive factor including main component, phonological loop, visual-spatial sketchpad, and temporary storage of events [5].Each of these components can store certain types of information.The task of phonetic circuit is to storeverbal information and the task of visual-spatial sketchpad is to store visual and spatial information.These two subsectors are in direct contact with central executor that is responsible for the task of coordinating cognitive system [6].Temporary storage of events maintains and integrates information contained in phonological loop, visual-spatial sketchpad, and long term memory [7].
Working memory is a term referring to a high level skill required for attention resource allocation despite interference or distraction [8] and measures simultaneous storage capacity and manipulation of information [9].This concept, which is related to attention, problem solving and control of impulsivity skills, is closely correlated with fluid intelligence and is a strong indicator of the extent of educational and career success.Because poor working memory is related to weakness in attention skills, it may cause attention deficit hyperactivity disorder (ADHD) and other difficulties in learning [10].Of course the importance of working memory in learning is not limited to children and it is important for each learning tasks and each age range.Deficits in working memory have negative impacts on various aspects of cognitive processes [1].Moreover, working memory affects our socialization due to the need to store and retrieve information from our surroundings.
Since working memory is important at any age range, its deficiency can cause learning and even occupational problems [11].Working memory capacity significantly increases during childhood [12] and has a distinct change in each age range [6].Generally, memory range increases rapidly from 6 to 9 years old and then gradually grows until about age 12 [13], then it reaches to its peak and remains constant during adulthood to about age 20 [1].Also working memory unlike IQ is not associated with parental education level and socioeconomic status.Equal opportunity to strengthen working memory can be provided for children, regardless of past or environmental effects [1].Therefore, working memory performance can be improved with cognitive training.
Today cognitive practices are presented by psychologists both traditional cognitive rehabilitation and computer.Cognition is defined as the ability to pay attention, receive, and understand information in order to integrate and maintain them in line with effective relationship.Thus, cognitive re-habilitation is a set of methods with interventional strategies in order to rehabilitate clients and aims to reduce the cognitive deficits [14].In general, the objective of cognitive and behavioral rehabilitation is to increase one's ability to process and interpret information and to improve all aspects of life [15].
Literally, "rehabilitation" is derived from the Latin word "re-habilis", in which "re" refers to one's previous ability and is any action to restore person's missed ability [16].Traditional cognitive rehabilitation programs are offered individually and in group by a trained person according to the needs of clients in each cognitive capability [17].Many traditional cognitive rehabilitation programs require face to face communication and are expensive as well [18].In contrast, computer technology has extensively progressed and made it possible to create training programs focused on cognitive development of children via computer [19].
On the other hand, although the boundary between playing and learning is not always clear and in theories such as Piaget's theory playing is not synonymous with learning [20], there has been strong evidence confirming the link between different types of play and mental development [21].Access to play devices is one of the strongest predictors of mental development even in the neonatal period [20].As the main activity of childhood is to play [21], there is no doubt playing can facilitate learning [20].Playing can enhance verbal skills, social skills, and awareness of feelings and emotions, it also results in self-culture, and it can develop the ability to use complex information and to organize them in a child by creating the ability to subjective review of a situation hap-pened in past for the child [21].According to Piaget, symbolic or imaginative play that emerges during the second year of a child's life can become an important learning experience [20].
Abilities of a child can be promoted through purposeful games [22].Games not only affect cognitive development, but also affect physical development, social development and emotional development of children.In addition, games besides entertainment are a great tool to facilitate and motivate learning [23].Games such as puzzles, matching words and forms, and chess have roles in improving working memory [24].In several studies, the relationship between motivation and cognitive activities with purposeful has been reviewed [25]- [28].
Today, children have much tendency to play computer games.Computer-based trainings is one of the modern methods of instruction that facilitates teaching and learning using computer-based technologies and has been widely welcomed because of the many benefits compared to traditional training [29].Learning through computer games can be classified as "active learning".In active learning, the emphasis is on learner's normal contemplation and activity in learning [30] and learner is responsible for learning and understanding the material [31].
In training through computer games, play process acts as a facilitator of learning.Today, active participation of learner in learning process is emphasized rather than learning experience [32].
Computer games besides entertainment can be a great tool to facilitate and motivate learning.It seems that using games is the best way to incorporate meaningful learning and entertainment [23].Computer and video games provide children the opportunity to do stressful assignments, teach them how to deal with the assignments is a creative manner [33], make learning fun and enjoyable, and encourage students to participate in educational activities by creating a sense of competition [34].Motivation in learning with computer participation affects learning activities and knowledge acquisition [35], can teach self-assessment to children, and enhance attention and concentration.The use of computer-based interventions and computer games can even improve children's cognitive skills [36].
Much research has been conducted worldwide concerning the impact of computerized cognitive training on working memory of children.Today, research on working memory and ways to enhance its capacity is one of the most important issues in the field of psychology [11].
Brain Ware Safari, a computerized cognitive training, was conducted on 40 children of the first to fourth grade of primary school with a learning disability for 12 weeks.The children were divided in to one control and one experimental group.Children in the experimental group during 12 weeks of intervention dedicated 5 days week for 30 minutes to computerized cognitive training.Pre-test and post-test data showed that subjects of experimental group compared to control group improved significantly in all assessed skills.
"Jungle Memory" is also a brain training program (2011).This weekly program using number of games has been produced and utilized to strengthen working memory [1].Many studies have been done on this computerized application in United States, Canada, Singapore, Brazil, China, Hong Kong, Australia and New Zealand.Alloway observed progress in students' grades, working memory, and IQ after running "Jungle Memory" for 9 weeks.This group was significantly different from the control group.The software also was run for a group of children with dyslexia disorder in Scotland in 2010 and 2011, and significant progress was achieved in their working memory.At a conference in Scotland in 2010 the results of this software were presented in improving working memory and language and math scores for children with autistic spectrum disorder after training 4 times a week for 8 weeks.
Cogmed is another computer program made for attention problems caused by working memory deficits.This cognitive computer program consists of computer games that according to research in Singapore, the Netherlands and Canada enhance working memory [37].
Moreover, Coglab is also another computer training program developed to enhance attention, perception, sensory memory, short-term memory, neurocognition, working memory, memory processes, Meta memory, and imagery.Several studies have been done on this computer program as well.
According to what was said, although educational psychology considers that learning requires efficient use of working memory and many studies have been conducted on the relationship between working memory and learning and academic achievement in Iran and academic achievement in Iran [38]- [42] and other countries [43]- [47], so far no computer training program for this issue has not been made in Iran.
This study seeks to strengthen the capacity of working memory through developing a proper Iranian Version of purposeful computer games, and has provided the first computer training program to strengthen working memory in Iran so that an appropriate intervention would promote working memory capacity of children efficiently.

Methods
This study is in R & D research category.The population included 72 students of the third grade (30), fourth grade (30), and fifth grade (12) of primary school selected by accessible sampling method from Tehran and Kish schools.After specifying content validity of "Working Memory Training Software" Software in this study, subtests of working memory in "Tehran-Stanford-Binet Intelligence Scale" and "Wechsler intelligence scale for children" were conducted as pre-test through Spearman Test.Subsequently, the software was conducted for 10 sessions to verify its effectiveness to strengthen working memory in children.After elimination of the pre-test effect, subtests of working memory in "Tehran-Stanford Binet Intelligence Scale" and in "Wechsler intelligence scale for children" were conducted as post-tests.

Researcher Made Scale to Examine Content Validity of the Software
To determine content validity, software was provided for two experts.Data from judgment of both experts tabulated independently using a four-point scale ranged from "irrelevant" to "extremely relevant".Then, using Spearman correlation coefficient [48], agreement between these two was obtained, this ratio indicates the extent to which the tool reflects the target.

Subtests of Working Memory in Tehran-Stanford Binet Intelligence Scale
The new version of Tehran-Stanford Binet Intelligence Scale in 2008 by Afrooz and Kamkari with a detailed review of the fifth edition of Stanford Binet Intelligence Scales was developed in 2003 [49].Tehran-Stanford Binet Intelligence Scale has 10 subtests, 2 of which are related to IQ measure of working memory.Today this view that was introduced by Baddeley (1986) is known as key component of intelligence in school learning [49].In this test, a class of memory process that stores a variety of information in long-term memory and reviews, saves, or transfers the information is known as working memory [49].Verbal working memory subtest continues from level 2 to 6.In level 2 and 3 simple sentences and in level 4, 5, and 6 compound sentences are raised.To remember the last word in the sentences start from level 4 and continues to level 6 [49].Nonverbal working memory subtest continues from level 1 to 6.In the first level, delayed and dismiss neural responses were noted.In level two, three, four, five and six, the process of hitting green cubes is followed.In level 2, a maximum of two cubes and in level 3, a maximum of 3 cubes are hit.This number increased to 5 in level 4, to 7 in level 5, and to 8 in level 6 and complications with emphasis on the cubes can be raised in yellow and red rows [49].Finally, using the total scaled scores of two subtests of verbal and nonverbal working memory, subject's working memory IQ is identified.

Subtests of Working Memory in Wechsler Intelligence Scale
Wechsler intelligence scale for children during a research project commissioned by the Department of Education of Chaharmahal and Bakhtiari and under supervision of Isfahan University was conducted on more than 900 subjects after translation and adaptation in 16 regions of the province.Normal tables with a review of 872 answer sheets were prepared by Abedi et al. [50].Subtests of working memory in Intelligence Scale and Kessler Scale are: 1) digit span, 2) sequence of letters and numbers.
In order perform to forward digit span, subject repeats numbers in the same way read aloud by the examiner.For backward digit span the subject repeats numbers inverted, but in this case the numbers are also read out aloud y the examiner [50].Digit span includes two components that are implemented separately, that means each component is implemented regardless of subject's score for the other component [50].The maximum score for forward implement is 16, it is 16 for backward, and it is 32 in total [50].Then, according to tables of benchmark scores and subjects' age, benchmark scores are achieved.Sequence of letters and numbers that is another subtest of working memory in Wechsler Intelligence Scale wants the subject to repeat numbers by ascending order and alphabets by alphabetic order [50].Each question consists of three attempts.For 6 -7-year-old children, recognition questions are used in order to be clear that they know counting and alphabet.If participant fails in recognition questions, arithmetic subtest is done [50].However, in this study arithmetic subtest was not necessary due to age group of subjects.

"Working Memory Training Software"
The computer program used in this study as an intervention has been produced by the researcher to provide computer cognitive exercises to strengthen working memory in children."WorkingMemory Training Software" consists of two games in order to strengthen working memory.After developing initial stories of the games, "story board" was used to prepare image."Story board" or illustrated screenplay is a bridge between a written screenplay and images world of visual media.The best way for visual expression of each action is story [51].Initial illustration of story board was finalized by "Coral Draw" graphic software."Coral Draw" software is a vector graphic editor application that is commonly used for drawing and less for editing images.With preparation of images by general-purpose, high-level, object-oriental, and interpreter programming language of Python, coding began.In order to register subject's information, a file called statics was embedded and its information could be converted into "xlsx" format.This file format is related to the database of "Excel"."Microsoft Office Excel" software is software suitable for charting and statistical analysis of data.Finally, after audio recording using "Cubase" recording software, which is one of the most important digital music composition software, volume was adjusted and music and audio files were added to the game.
In general, in these two games it has been attempted to employ verbal working memory (auditory working memory) and visual-spatial working memory.Remembering and following long instructions successfully, remembering long sentences that encompass content, and remembering sentences with complex grammatical structures are activities that cover verbal/auditory working memory [1], which are used in both games.Also, activities such as using images to remember and selecting largeness or smallness according to need that involve visual-spatial working memory [1] have been included in both games.

Flower Game
In flower game, the main character of story is going to plant a flower for his/her grandmother to give her as a gift.First, the game introduces plant and planting equipment to the child.The introduction of planting equipment is either verbal, written, or as picture.Thus, it targets visual memory and auditory memory.It also results in picture and pattern sense.The child is then expected to choose a suitable pot with respect to plant seen in the previous plan.In next stage, the child should have a correct function to plant the flower using prior knowledge among planting equipment.However, the child is given some instructions about proper function of planting during the game.Therefore, the subject is expected to choose correct options by recalling the planting equipment and the mentioned notes.Overall, in flower game right choice and problem solving with recalling previous data will be reviewed within six questions.

Cake Game
In this game the main character is going to help his/her father bake a cake for his/her mother's birthday.After choosing cake recipe paying attention to the details of image by the subject, cake recipe for four people is presented in written form and verbal form.Then, the child is expected to choose sweet ingredients from the list that has been appeared as a picture.Subsequently, the child is expected to select a right place to make cake.Moreover, since in the beginning of the story the child is told that the cake recipe is for 4 people but there are 8 people, he/she should choose the amount of ingredients as well.In this game, which is more difficult than flower game, the child is expected to answer to 12 questions by recalling previous data and to make the right choice.

Results
Demographic data from this study indicate that 41.7% of subjects were in the third grade, 41.7% if subjects were in the fourth grade, and 16.7% of them were in the fifth grade of primary school.The mean age of the subjects was 9.82.50% of subjects were girls and 50% of them were boys.
Table 1 indicates descriptive results of pre-test and post-test scores of working memory by grade.Spearman test (r s = 1) considers cake game as 100% reflecting the target.Content validity of flower game (r s = 1) is also appropriate.Finally, content validity of working memory training software was appropriately evaluated according to coefficient of above test (r s = 1).
In order to evaluate the research hypothesis, paired t-test was used.After intervention and elimination of the pre-test effect, paired-samples t-test on total scores of subtests of working memory in "Tehran-Stanford Binet Intelligence Scale" (t = −10.869,df = 71, r = 0.967 & P < 0.05) and in "Wechsler intelligence scale for children" (t = −16.809,df = 71, r = 0.983 & P < 0.05) reveals a significant difference in post-test scores (Table 2).

Discussion and Conclusion
In order to investigate the hypothesis that working memory training affects students' working memory performance, after software content validity paired t-test was used.The results showed that according to Spearman correlation coefficient (r s = 1) content validity is good, i.e. components of tool cover content well [48].When the content validity is high, it can be used with more confidence [52].Therefore, with 100% confidence this software can be used to enhance working memory.
Mean score of working memory test after interference of "working memory training software" was significantly different.After intervention and elimination of the pre-test effect, paired-samples t-test on total scores of subtests of working memory in "Tehran-Stanford Binet Intelligence Scale" (t = −10.869,df = 71, r = 0.967 & P < 0.05) and in "Wechsler intelligence scale for children" (t = −16.809,df = 71, r = 0.983 & P < 0.05) reveals a significant difference in post-test scores.Therefore, after intervention students' working memory performance improved.According to above results and proper correlation coefficient between scores of pretest and posttest after elimination of intervention effect, answer was given to the hypothesis.It was supported, so working memory training affects students' working memory capacity.The result of the study was consistent with previous studies (e.g.Jungle Memory, Cogmed, Coglab, and Brain Ware Safari).
Selecting equal numbers of boys and girls in each grade was a limitation of the study.This limitation reduces the ability to generalize findings to gender of subjects.Another limitation was the use of computer equipment in It is recommended to obtain validity of the intervention program, "Working Memory Training Software", using random samples and considering the larger sample size.Another recommendation is to investigate effectiveness of "Working Memory Training Software" on academic performance of children.The researchers are also suggested to perform this intervention for special groups such as children with learning difficulties.
Time impact on the intervention effectiveness has not been evaluated.If a research is able to evaluate the intervention effectiveness after the intervention period at different intervals, long term effectiveness of this treatment modality will be determined.
Studying effectiveness of this intervention for both verbal working memory and visual-spatial working memory can obtain intervention disadvantages for better effectiveness on all aspects of working memory.
Researchers can develop advanced versions of computerized cognitive training programs under net command and thereby they can perform the intervention at homes through the Internet and reduce costs.
Finally, according to the needs of children to such computer programs due to the need to improve cognitive function, schools and officials are recommended to include working memory training programs in school curricula according to grade level, and also to include "Working Memory Training Software" in recreation program of student at schools.

Table 1 .
Descriptive findings of working memory test.

Table 2 .
Paired t-test in Tehran-Stanford Binet Intelligence Scale and Wechsler intelligence scale for children.As a result, the study was conducted slowly.The next restriction is a research limitation.The study was performed in a semi-experimental design.It was not possible to realize random assignment of subjects the same as experimental studies.