Reliability Verification and Practical Effectiveness Evaluation of the Nursing Administration Analysis Formulae Based on PSYCHOMS® ()
1. Introduction
Efforts have been extensive in improving the quality of care and hospitalization of psychiatric patients particularly in their treatment, and the quality of care available community mental health and social welfare services [1] -[4] . It is known that Japanese psychiatric hospitals are overcrowded, involving long patient hospitalization stays, thereby increasing their likelihood of having complicating diseases because of aging.
As a vision of the reform for mental health welfare of 2004, psychiatric and mental health treatments towards community care of the mentally ill were promoted instead of continuing inpatient psychiatric hospitalization [5] . In order to improve the quality of life of psychiatric patients through accurate and appropriate mental health services, nurse administrators must be able to determine how to provide high-quality nursing care and integrated rehabilitation which are most effective and efficient [6] -[8] . However, in psychiatric hospitals, there are few physicians and nurses as compared to the general hospital. Patient and physician ratio is 48 patients to one physician, while patients and nurse ratio is 15 patients to one nurse. However, in general hospitals in Japan, the average ratio of patients to physician is 16 patients to one physician, and 7 patients to one nurse [9] .
In addition, the problem of long-stay hospitalization is still a pressing issue in Japan [10] [11] . Therefore, as the supporting system for providing maximum efficiency of medical services using limited human and material resources, the Psychiatric Outcome Management System (PSYCHOMS® registered trademark) was developed guided by perspectives from a nursing standpoint.
Analyzing the current situation in psychiatric hospitals, forming strategies and using these in actual nursing practice are keys for achieving and maintaining high-quality human health care [12] [13] , thereby supporting the critical nature of nurse administrators’ work of analyzing information/data. While the scope of nursing administration has expanded in recent years, and the information required for nursing administration has increased dramatically in both volume and diversity [14] , the clinical site has also changed radically with each daily practice. Nursing administrators are asked to make timely and informed decisions according to data derived from situations founded on increasing evidences which are exact and central to the undertaking at hand.
However, nurse administrators are limited in their ability to compile and analyze information for nursing administration. Nurse administrators in psychiatric wards would greatly benefit from the development of a nursing administration analysis system that could perform personnel arrangement simulation, manage information on nursing staff and ward operations [15] . PSYCHOMS® can allow nurse administrators to make these appropriate and critical decisions.
Within the PSYCHOMS®, the nursing administration analysis formula was developed to benefit nurse administrators [16] . This is currently under consideration for patent approval [17] . The purpose of this study was to examine the validity of the formulae and the Structured Query Language (SQL) statement, and its practical effectiveness of analyzing data.
2. Methods
2.1. Setting of the Study
Information on the psychiatric hospital “A” for analysis: the specialties of psychiatric hospital “A” where analytical information was acquired include the Department of Psychiatry and Psychosomatic Medicine. In-patient wards are for psychiatric acute ward (1 ward, 60 beds), psychiatric chronic wards (3 wards, 180 beds), neurological diseases treatment ward (1 ward, 60 beds), and dementia treatment ward (1 ward, 55 beds).
2.2. Analysis Formulae
This analysis formula [16] [17] uses two different approaches: 1) data are classified into types of information as desired by the nursing administrator, 2) extracted data required by the nursing administrator. This formula can be classified information registered in the database based upon categories (S_category) and conditions (S_condition) established by the user, from which the information is extracted that correspond to the condition. Analysis formulae are indicated below:
(1)
(2)
(3)
(4)
inf ( ): analytical (classification/extraction) information;
x: the selected condition;
i: the factor meeting the condition;
j: the factor meeting the condition x;
m: the total number (record);
S_category: the selected category;
S_condition: the selected condition;
EF (1): the first analytical result;
EF (2): the second analytical result;
EF (n − 1): the n − 1st analytical result.
In addition, the operator “■” in formulae (1)-(4) represents the extraction of overlapping parts of records in the former and latter parts and on the right side of the equation. To view classified data, when there are multiple categories and/or conditions, records matching each category and condition must all be extracted from the data tables of the database.
2.3. Methods of Verification Test
1) To build the database, using the data for nursing administration of the hospital “A”.
2) To output data from the created database, using SQL search statements, being based on the following analysis framework (Figure 1).
3) To evaluate quantitatively the output data of the practical effectiveness using the nursing administration analysis formulae, from the viewpoint of psychiatric nurse administrators.
There were eight evaluators: 2 nurse administrators, 3 nursing administration researchers, and 3 persons experienced in software programming. The period was from August 2014 to October 2014.
2.4. Ethical Considerations
Ethical consideration for this study was assured by obtaining permission to conduct this study from the Clinical Research and Ethical Review Board of Tokushima University (receipt number: 1501-1).
Figure 1. Analysis framework: analytical process and estimated results.
3. Results
3.1. Analysis 1: Collation of Nursing Staff Assignment in Psychiatric Chronic Wards and Staff Nurses’ Competence Levels
Step 1: Display the number of nursing stuff applicable to a career ladder level of each psychiatric chronic ward (Table 1).
Formula
(1)
SQL statement
SELECT: ward_function, hospital_ward, career_ladder_level_by_self, career_ladder_level_by_a_head_nurse, COUNT(*)
FROM: nursing_staff_administration_database
WHERE: ward_function = ‘psychiatric_chronic_wards’
GROUP BY: ward_function, hospital_ward, career_ladder_level_by_self, career_ladder_level_by_a_head_ nurse
Step 2: Display the nursing staff name which shows the career ladder level by self and by a head nurse. The difference can be seen in the classified result of Step 1 (Table 2).
Formula
(2)
Data table (1) is a table holding all the records of the staff applicable to inf (x).
SQL statement
SELECT: ward_function, hospital_ward, nursing_staff_name, career_ladder_level_by_self, career_ladder_ level_by_a_head_nurse
FROM: data_table (1)
WHERE: career_ladder_level_by_self <> career_ladder_level_by_a_head_nurse
Step 3: Display the applicable staff’s years of clinical experience is displayed from the extracted result of Step 2 (Table 3).
Formula
(3)
Data table (2) is a table holding all the records of the staff applicable to inf 2 (x).
SQL statement
SELECT: ward_function, hospital_ward, nursing_staff_name, staff’s_ years_of_clinical_experience
FROM: data table (2)
WHERE: staff’s_ years_of_clinical_experience
3.2. Evaluation of the Analysis Result 1
The competency of staff assigned to 3 psychiatric chronic wards was classified according to their career ladder levels. Then the staff names and their years of clinical experience with a difference of their career ladder by self and by a head nurse, were extracted. This result can be useful as an evaluation indicator in order to quantitatively/ qualitatively provide staff assignment according to the characteristic of the wards.
Table 1. Classified results of the collation of nursing staff assignment and stuff nurses’ competence levels in each psychiatric chronic ward.
The number shows the number of nurses in the career ladder level.
Table 2. The extracted results of the nursing staff name which career level by self and by a head nurse differ in classified result of Step 1.
Table 3. The extracted results of the applicable staff’s years of clinical experience is displayed from the extracted result of Step 2.
3.3. Analysis 2: Collation of Preceptor Nurse’s Ladder Level and His or Her Skill
Step 1: Display the extraction of preceptor nurse’s name in all wards of the A hospital (Table 4).
Formula
(1)
SQL statement
SELECT: hospital_ward, nursing_staff_name
FROM: nursing_staff_administration_database
WHERE: role = “preceptor”
Step 2: Display the preceptor nurse’s career ladder level from the result of Step 1 (Table 5).
Formula
(2)
Data table (1) is a table holding all the records of the staff applicable to inf (x).
SQL statement
SELECT: hospital_ward, nursing_staff_name, preceptor_nurse’s_career_ladder_level
FROM: data_table (1)
Step 3: Extracted result of the achievement situation toward the career ladder level from the result of Step 2 (Table 6).
Formula
(3)
Data table (2) is a table holding all the records of the staff applicable to inf 2 (x).
SQL statement
SELECT: hospital_ward, nursing_staff_name, career_ladder_level_by_a_head_nurse, achievement_situation_ toward_the_career_ladder_level
FROM: data_table (2)
3.4. Evaluation of the Analysis Result 2
By having extracted the data of the preceptor nurse, it was shown clearly that the preceptor nurse was not assigned in all the wards, and was found that all preceptor nurses did not achieve the career ladder level Ш-1. These information serves as data for work on the policy not only based on the education for novice nurse but also the education of the nurse who plays a role of their leader level, or one who offers high quality nursing care.
Table 4. The extracted result of preceptor nurse’s name in all wards of the A hospital.
Table 5. The extracted result of the preceptor nurse’s career ladder level.
Table 6. The extracted result of achievement toward the career ladder level.
The number shows an applicable nurse’s number.
4. Discussion
The contents of care required in psychiatric hospitals differ in accordance with the function of each respective ward [18] - [21] . Therefore, in order to provide appropriate service to patients, a nursing administrator must make efforts to organize information concerning the degree of busyness and the abilities of nursing staff as well as to correctly understand the characteristics and appropriate placement of nursing staff in each ward. The reuse of stored data will give a powerful tool for management of nursing schedule and lead to improvement of hospital services [22] [23] . However, the information that the nursing administrator requires is not only an aggregation of quantitative data, coefficient of correlation or analytical results of the difference between the averages, but also any method assembling this information should also extract and show what information is included in outliers.
As shown in Analysis 1, the nursing administrator requires, from the results of quantitative analysis, information concerning in whose cases the career ladder level placement by one’s own assessment is different from that by the chief nurse, and where the difference between one’s self-assessment and the assessments by others lies. Analytical results were divided into whether career ladder levels in the chief nurse’s assessment are higher or lower than those in the self-assessment of nursing staff. These results are shown in the screen display of a computer, which shows that necessary information was successfully obtained.
In Analysis 2, the practical abilities of nurses playing the role of preceptor are extracted. In hospital “A”, the nurses who attain career ladder level Ш-1 are qualified as preceptors. However, from the results of Analysis 2, all six preceptor nurses did not achieve the items required in ladder level III-1 and did not fulfill the necessary requirements. In previous studies, research showed the improvement of nursing outcomes with data mining using the data saved in the database of the hospital [22] [23] .
What nursing administrators require is a method of objective assessment of the abilities of staff and information useful in deriving what ongoing education is necessary for the improvement of the quality of nursing [24] [25] . Also, when nurses are educated about performance and quality measures, are engaged in identifying outcomes and collecting meaningful data, are active participants in disseminating quality reports, and are able to recognize the value of these activities, data become one with practice [26] .
Because information is quantitatively handled in statistical processing, it is difficult for the nursing administrator at the nursing site to calculate necessary information by combining qualitative and quantitative information. As a result of analysis based on the developed calculation formula, it was possible to show necessary information by mixing both calculation methods of analysis and extraction as well as by combining quantitative and qualitative data. Nursing administrators who really understand the necessity of information analysis input various data into spreadsheet software. However, they lack a comprehension of what can be read out from the input data. Or they cannot make full use of the analytical method, so that the actual situation is that the vast amounts of information collected often cannot be used [27] [28] .
The system is developed by focusing on support for the idea of nursing administration analysis. For example, in order to analyze the actual condition of a ward, it is necessary to make analyses, from various perspectives, such as “what happens to ‘B’ under the conditions of ‘A’? and what happens to ‘C’?” For this purpose, it is required to rearrange and filter the data using spreadsheet software in each case. In the calculation formula that Miyagawa et al. [16] proposed, the nursing administrator can classify data and extract necessary information by intuitively combining the data of “A” and “B” on a screen display. The nursing administrator, even if he/she is unfamiliar with statistical processing, can obtain the information necessary for combination from the information input in the database.
There are some competent nursing administrators acquired the degree of master of business administration or the PhD in nursing, having capability of information analysis or statistical analysis. Moreover, nursing informatics is established as one of the fields of nursing science, and this specialist offer information that nursing administrator’s needs. However, in Japan, there is little such in the present condition [29] . Therefore, we developed the methodology which can do analysis intuitively, even if the nurse administrator is not well versed in information analysis. It was thought that this methodology is effective in order to support a nursing administration’s decision-making.
The major limitation of the study is evaluated results in the one hospital. It is necessary to perform subsequent experimental study on several hospitals, and to improve developed formulae in order to use by an electronic nursing system.
5. Conclusion
Information required for nursing administration was able to be analyzed and displayed according to the need of each nurse administrator. Especially, it has verified that information important for the nursing staff assignment for assuring the quality of nursing care according to a ward function or the characteristic was acquired.
Acknowledgements
We would like to express our deep gratitude to the participants of this study, our family members, and members of Professor Dr. Tanioka’s laboratory. In particular, we wish to thank the Prof. Dr. Fuji Ren, and the nurse administrators who cooperated this study. Also, this study was supported by a grant from the Strategic Information and Communication R & D Promotion Program (SCOPE) in Japan (No. 122309008).