Verifying the Effects of an Education Program Leveraging Information Technology to Promote Cervical Cancer Screening in Women Aged 20 - 29—A One-Year Longitudinal Study ()
1. Foreword
Over 78% of cancer cases in the AYA (adolescent and young adult) generation in Japan are female. One element of this is an increase in cases of cervical and breast cancer [1]. In a study concerning malignant tumors associated with pregnancy, of 225 cases, cervical cancer was the most common cause at 72% and 13% - 30% chose not to continue their pregnancies [2]. Additionally, the average age of first marriage is 29.4 years and the average age at the birth of the first child is 30.7 years. This aligns with the peak age group in which cervical cancer is most often diagnosed (25 - 39). Therefore, it would be beneficial to promote regular cervical cancer screenings for women starting in their 20s [3] [4]. However, compared to other countries, which have cervical cancer screening rates of 70% - 80%, Japan’s rate is quite low at only 43%. This is even lower among women in their 20s at only 22.2% [5] [6].
HPV vaccination is not being actively encouraged, which makes the promotion of cervical cancer screenings for women in their 20s an urgent matter in need of attention. If the screening rate is not increased, there may be an increase in cases discovered during the initial screening during pregnancy, possibly leading these women to terminate their pregnancies.
Considering the above points, it is clear that regular screenings as preventative care will help to maintain health for all women and fertility for women who intend to give birth. To this end, we implemented an educational program targeted at women in their 20s. One group of women participated in the program, while the control group did not. In this study, we compare the two groups to verify the effectiveness of the educational program.
2. Research Method
2.1. Study Design
This research is a comparative study of the intervention group, which took part in our educational program, and the control group, which did not.
2.2. Subjects
The subjects were women in their 20s who are unmarried and have not given birth and who gave permission to be included in the study. The contents of the study were specified through public advertisements, flyers, directories, and social media. The subjects decided whether to participate in a health course. The intervention group consists of those who participated in the course and the control group consists of those who did not.
2.3. Survey Period
April 2019-July 2020.
2.4. Hypotheses
1) The intervention group will score higher than the control group when tested on cervical cancer knowledge after one year.
2) The intervention group will have more positive health beliefs than the control group regarding cervical cancer screenings after one year.
3) The intervention group will show a higher rate of cervical cancer screenings than the control group after one year.
2.5. Summary of Health Course and Education Program Leveraging IT to Distribute Information (Table 1)
We designed an educational program aimed at preventing cervical cancer in consideration of the Health Belief Model (HBM) and past literature, referencing the health curriculum studied by high school students. The program consists of two parts: a health course followed by distributing information about cervical cancer and screenings at one and six months via images sent through IT-based methods. The contents of the course were carefully selected from Leading a Healthy Life (for high school students) [7] and Materials for Cancer Education [8] by the Ministry of Education, Culture, Sports, Science and Technology, Twelve New Provisions for Preventing Cancer [9] by the Foundation for Promotion of Cancer Research, and Cancer Prevention Based on Scientific Grounds [10] by the National Cancer Center Japan. These were discussed by a committee consisting of a doctor, a nurse, a midwife, two school nurses, and two nursing researchers (a total of 7 people). These considerations resulted in the five categories which make up the program: Toward a Healthy Lifestyle, About Cancer, About Cervical Cancer, About Cervical Cancer Screening, and the IT-based effort to promote screenings, Knowledge Review and Hospital Search Guide.
The focus of health education in Japan is preventing lifestyle-related diseases and promoting healthy, balanced lifestyle habits via the health curriculum in elementary, junior high, and high schools. First, we reviewed topics that are covered in high school, such as healthy life habits (diet, smoking, alcohol), viruses and infectious diseases, pregnancy and childbirth, and cancer prevention.
Table 1. Content of education program.
We then covered cancer itself, the state of cancer in Japan, and cancer in the adolescent and young adult generation, followed by the structure of the womb, uterine and cervical cancer, causes of cervical cancer/the relationship between cervical cancer and smoking/HPV, and what can be done to maintain fertility if diagnosed with the precancerous conditions which lead to cervical cancer. We also explained the current state of cancer among women in their 20s, treatments, number of cases, deaths, and cost. To avoid giving the subjects an inflated fear of cancer, we emphasized cancer prevention and the goals of doing so. Regarding cervical cancer screenings, we presented subjects with images and figures showing the significance of cervical cancer screening, a comparison with screening rates in other countries, the screening rate of women in their 20s, a concrete example of the screening test, and target/recommended ages for screening. Then, a video of a simulated screening was shown to allow the subjects to build a mental image of the procedure. The goal of the program was to leave this impression and lead the subjects to realize that they could take action, then and offer encouragement and support for them to seek screening in a way that fits their lifestyle. The total length of the course was approximately 75 minutes.
The health course for the intervention group was conducted with small groups a total of 44 times across the Kinki, Chugoku, Tokai, Hokuriku, and Kyushu regions of Japan, with an average size of 3.1 people.
2.6. Data Collection Method
1) Survey Procedure and Measurement Instruments
As part of the education program, we examined the effectiveness of the health course and the information sent via IT-based methods by having the subjects take surveys about cervical cancer screenings six months and one year later. In the surveys, the subjects responded to questions on the Health Belief Model Scale and we verified whether they had undergone a screening in that time. Based on the Stages of Behavior Change in the Transtheoretical Model (TTM), we performed interventions at one month and six months after the initial survey: one during Preparation stage, in which the subject plans to change their behavior within a month, and the other during the transition between the Action stage and Maintenance phase.
For the intervention group, the measurement periods were before, after, six months after, and one year after the health course. For the control group, they were during, six months after, and one year after the initial survey. The survey procedure is shown in Figure 1.
At the time of the initial survey, we confirmed factors which are known to be related to cervical cancer screening behavior for both groups. These factors include age, whether they have had a health exam, and past experience with gynecological care. We evaluated the effectiveness of the program based on subjects’ knowledge of cancer prevention/cervical cancer screening, the Health Belief Model Scale for Cervical Cancer and Pap Smear Test (henceforth abbreviated as HBMSCCPST), and whether the subject went for a pap smear test. The knowledge tested is concerned with healthy lifestyles and cervical cancer screening, and the questions were created from items widely used in previous literature.
The HBMSCCPST is method of evaluating women’s health beliefs with regard to cervical cancer screening and consists of 35 items and five factors: Pap Smear Benefits, Pap Smear Barriers, Seriousness, Susceptibility, and Health Motivation. It measures agreement with each item on a 5-point Likert scale ranging from “Strongly disagree” to “Strongly agree”, with a higher score indicating a stronger degree of agreement. Gulten Guvenc has reported that this tool was found to be
Figure 1. Survey procedure for this study.
a valid and reliable tool in assessing women’s health beliefs [11] [12]. The creators and translators of the scale have acknowledged its use in this research. Construct validity has been verified through factor analysis, giving Cronbach alpha coefficients greater than 0.7. However, while the subscales of Benefits, Barriers, Seriousness, and Susceptibility had Cronbach’s alpha reliability coefficients of 0.71 - 0.86, the Health Motivation subscale only had a coefficient of 0.46. Due to this, it was excluded from analysis.
2) Method of Data Collection
At the time of the initial survey, we had subjects scan a QR code containing a URL and respond to an Internet-based questionnaire. We also asked subjects in the intervention group to do so by the same method again following the health course. At six months and one year later we sent a URL to the email address register during the initial survey, which subjects were free to respond to. As a longitudinal survey, we tracked the data using a 4-digit PIN entered by each subject so the data would not contain personally identifying information. Data was entered using the online questionnaire service SurveyMonkey, which conforms to European Union General Data Protection Regulations (GDPR).
2.7. Method of Analysis
Survey items were analyzed according to descriptive statistics. After tallying the cervical cancer knowledge and HBMSCCPST scores using simple tabulation, the data was analyzed between the intervention and control groups. Comparison of the groups’ attributes and knowledge/HBMSCCPST scores was done via the Mann-Whitney U Test, and repeated two-way analysis of variance was performed before, after, six months after, and one year after intervention. Before/after comparison between groups was done via the Friedman test. The number of subjects who had a pap smear test was compared via Fisher’s exact test. Freeform responses were analyzed with the text mining software KH Coder [13]. The terms used in co-occurrence analysis were those with a Jaccard index greater than or equal to 0.2. KH Coder is an open source software tool for computer assisted qualitative data analysis, particularly quantitative content analysis and text mining. A co-occurrence network was created by KH Coder based on the frequency and pattern of the extracted words. Each color indicates a cluster of words (a topic) used close together in sentences. Strongly related words are connected by lines.
2.8. Ethical Considerations
This research was conducted with the approval of the Osaka Medical College Research Ethics Committee. We provided a description of the research in writing (as well as verbally for the intervention group). This description explained the intentions, goals, and methods of the research, that it was voluntary, that participants could withdraw at any time, the protection of private information, and the handling of collected data. Participants were able to participate after agreeing to the terms.
3. Results
3.1. Subject Attributes (Figure 2, Table 2, Table 3)
We received responses from 145 respondents in the control group and 148 in the intervention group, for a total of 293 subjects. Our analysis excluded subjects who did not meet the requirements for this research. Valid responses were as follows (seen in Figure 2): Initial Survey: intervention group 142 (95.9%), control group 145 (100%); Six-Month Survey: intervention group 37 (26.1%), control group 30 (20.7%); One-Year Survey: intervention group 33 (23.2%), control group 27 (18.6%). The characteristics of the subjects are shown in Table 2. The average age of the subjects was 24.4 ± 2.96 years for the intervention group and 23.4 ± 2.24 years for the control group. No significant difference in background was observed in either group. No significant difference was seen between groups in regard to interest in cervical cancer screenings; Contemplation was the most populated stage, followed by Action, Precontemplation, and Preparation.
3.2. Program Evaluation Regarding Initial, Six-Month, and One-Year Surveys (Table 4, Table 5)
1) Intra-group comparison of HBMSCCPST subscales and knowledge scores
The intervention group showed a significant difference in the Benefit subscale
Mann-Whitney U test.
Table 3. Participant interest in screening.
Mann-Whitney U test.
Table 4. Comparison of knowledge and HBMSCCPST scores in the initial 6-month and 1-year survey.
Two-way ANOVA. **p < 0.01; *p < 0.05.
of the HBMSCCPST in the six-month survey (p = 0.017). Scores in the Healthy Lifestyles knowledge category were significantly higher than the initial survey (p =
Table 5. Inter-group comparison of changes in knowledge and HBMSCCPST scores between initial and 1-year surveys.
Mann-Whitney U test. *p < 0.05.
0.003) or the one-year survey (p = 0.001). In the Cervical Cancer category scores were significantly higher after one year than in the initial survey (p = 0.000) or after six months (p = 0.000). In the Cervical Cancer Screening category scores had increased significantly after one year compared to the initial survey (p = 0.001).
The control group showed no significant differences in the HBMSCCPST subscales. In the Healthy Lifestyles knowledge category scores were significantly higher after six months than in the initial survey (p = 0.005) or after one year (p = 0.004). In the Cervical Cancer category scores were significantly higher after one year than in the initial survey (p = 0.000) or after six months (p = 0.043).
2) Inter-group comparison of HBMSCCPST subscales and knowledge scores
After comparing the one-year surveys of both groups, significant differences were shown in the Healthy Lifestyles (p = 0.000) and Cervical Cancer Screening (p = 0.000) categories. We observed significant differences in score changes between the initial survey and one-year survey in the Cervical Cancer (p = 0.027) and Cervical Cancer Screening (p = 0.016) categories. A small effect size was observed on Healthy Lifestyles (γ = −0.14) and Seriousness (γ = −0.10).
Changes in HBMSCCPST subscales and knowledge scores were examined via two-way analysis of variance of condition (intervention/control group) and time of measurement (initial survey, six months, one year). A significant main effect and interaction were observed in the intervention group in the Cervical Cancer category [F(2, 57) = 7.95, p = 0.00, η2 = 0.22] with a large effect size. A main effect and medium effect size was observed in the knowledge categories Healthy Lifestyles [F = 1.669, p = 0.17, η2 = 0.06] and Cervical Cancer Screening [F(2, 57) = 18.012, p = 0.00, η2 = 0.09]. On the other hand, no interaction was observed in the HBMSCCPST subscales. However, a medium effect size was seen in the Benefits subscale [η2 = 0.06], and small effect sizes in the Seriousness [η2 = 0.01] and Susceptibility [η2 = 0.02] subscales. No effect size was shown in the Barriers subscale.
3) Program Evaluation (Figure 3)
After one year we requested thoughts and opinions on the program. 33 subjects provided input. A total of 765 words consisting of nouns, verbs, adjectives,
Figure 3. Co-occurrence network of opinions and impressions of educational program.
and adverbs were extracted for analysis. The average frequency of each word was 2.2, with a standard deviation of 3.0. As a result of a co-occurrence network analysis which searches the extracted words for shared links and similar patterns, 9 subgraphs were extracted as shown in Figure 3: Cervical Cancer Screening Opportunities, Health Course Teachings, Reaffirming Importance, Screening Consultation, Understandable Lecture, Regular Information, Realizations from Survey, Time and Experience for Screening, and Positive Impressions. We found the words shikyukeigan (cervical cancer), kenshin (health screening), jushin (medical exam/consultation), and kikai (opportunity) mediated with a large number of words. Health Course Teachings was connected to Cervical Cancer Opportunities. Reaffirming Importance and Regular Information were connected to Screening Consultation. Respondents realized the importance of their own health from Understandable Lecture and Realizations from Survey, connecting to Time and Experience for Survey. Health Course Teachings and Understandable Lectures were not connected, however.
3.3. Cervical Cancer Screening Consulting Behavior (Table 6)
While no significant difference was found in the percentage of subjects who had had a cervical cancer screening after one year, a small-degree effect size was observed. Of the intervention group, 10 (30.3%) had a screening versus 4 (14.8%) in the control group. In both groups, the most common reason for being tested was “Recommended by healthcare provider”. For the intervention group the
Table 6. Relationship between cervical cancer screening and HMBSCCCPST subscale/knowledge score.
Mann-Whitney U test. *p < 0.05.
next most common reasons were “Health course” and “Recommended by workplace”. For the control group, the next most common reasons given were “Free voucher” and “Recommended by mother”. Reasons given for not being tested were, in order of frequency for both groups, “Didn’t have the chance”, “Didn’t have time”, “don’t know how to get one”, and “because of the COVID-19 pandemic”. 64.3% of screenings were done at the discretion of the patient, with the rest being done through workplace health examinations, etc. Of those, 42.9% each were funded personally or through municipal financial aid. There were no significant differences associated with knowledge scores or HBMSCCPST subscales and the whether subject had a cervical cancer screening or not. However, a small-degree effect size was found in Benefits (γ = −0.10), Barriers (γ = −0.25), Susceptibility (γ = −0.17), and Healthy Lifestyles (γ = −0.16). Additionally, there was no significant difference in interest in the level of cervical cancer screening or consulting behavior.
4. Considerations
4.1. Subject Characteristics
In this study, we examined the intervention effect of an education program on women in their 20s aimed at promoting cervical cancer screenings. There were no significant differences in the backgrounds of the intervention and control groups. We predicted there would be differences in the TTM stages of interest regarding cervical cancer screening between the intervention and control groups, however no differences were found in either group. According to the RE-AIM (Reach, Efficacy, Adoption, Implementation, and Maintenance) framework proposed by Glasgow, external validity was captured with regards to preventive interventions on health [14].
4.2. Effectiveness of Education Program
Studies both in and outside Japan regarding the prevention of cervical cancer have made it clear that education programs have a positive effect on knowledge [15] [16]. In our study as well, we observed main effects and interactions in knowledge categories from the initial survey and six-month and one-year surveys and a small effect size, we consider this the health program to have had an effect on knowledge scores. Additionally, while significant differences were not shown in HBMSCCPST subscales, small-degree effect sizes were shown in Benefit, Seriousness, and Susceptibility. Haywood has proposed individual counselling, goal setting, and group counselling as methods of intervention [17]. Because this study was carried out in small groups with the steps of a cervical cancer screening shown visually through video, we believe that not only did subjects’ knowledge improve, but that they were able to build a mental image of the procedure. On the other hand, the control group showed a significant difference in knowledge scores in Healthy Lifestyles and Cervical Cancer. We presumed that these differences occurred due to the Healthy Lifestyles category being based on the high school curriculum; subjects were reminded of what they had learned in the past. We also inferred that being involved with the survey itself may have served as an impetus for subjects to learn more about cervical cancer on their own.
In past studies, increasing knowledge of diseases and their prevention was shown to be related to improvement in the Susceptibility and Seriousness HBMSCCPST subscales as well as the Benefits and Barriers to preventive behavior [18]. While our study showed an increase in knowledge scores, we did not see an improvement in the Seriousness HBMSCCPST subscale. Objective information alone is not enough to move people to change; impressions are important. For a web-based health counselling program, creative and innovative methods of intervention are necessary to increase and maintain subjects’ interest amid a digital environment flooded with information [19] [20]. That is, the images from the health course and the IT-based screening promotion designed for the Digital Native generation did not increase interest or lead to health consulting behavior for women in their 20s. A population-based approach must be considered that is more helpful to women in this age group while still being offered in a timely manner.
4.3. Cervical Cancer Screening Consultation Behavior
No significant difference was observed in the number of subjects having cervical screenings done as a result of the intervention. The rate of subjects in the control group which had a screening was the same as the average for all women in their 20s in Japan (22.2%), while the intervention group was above average at 30.3%. For screening behavior, whether the subject takes action or not depends on if they are more conscious of the benefits or the barriers or preventative action. The promotion of cervical cancer screening will require not only information distribution, but also a reduction in perceived barriers [21] [22]. While our study showed an improvement in Benefits, Seriousness, and Susceptibility, the lack of change in Barriers suggests it did not lead to screening behavior. In their research, P.H. Youl et al. sent out continuous text messages about preventing disease and implemented a follow-up program after three months. Afterward, they continued to promote preventative behavior by sending monthly text messages [23]. In our research, text messages were sent after the first month and sixth month. This had an effect on Benefits after six months, but it did not continue to one year. In addition, in the free description of the educational program, the effect of the lecture and words indicating the importance of cervical cancer were generally positive, but the images sent using IT were not mentioned. This suggests that a more long-term follow-up is necessary to make subjects understand the value of cervical cancer screening and stimulate the screening rate among women in their 20s.
Reasons given for being tested include recommendations from the healthcare provider or mother and having a free voucher. The majority of screenings were done at the patients’ discretion. Reasons given in both groups for not being tested were a lack of time or opportunity.
In Japan, because financial aid for cervical cancer screenings differs based on municipality, free vouchers are only valid where patients have a certificate of residence. Additionally, for screenings covered through the workplace, the method of applying for compensation varies. The most common routes for screening are through the municipality for college students and through the workplace for the general population, so these entities also serve an important role regarding surveys [24] [25].
A survey in Sweden has reported a method of promoting cervical cancer screenings. When patients come in for their first screening, a special appointment is made to provide adequate time and support. The time and place of the screening, as well as which specialist the patient will see is set in advance. It can also be combined with other tests, promoting future visits. Furthermore, in the school health curriculum school nurses serve a special function that produces great results [26]. That is, strategies for the first screening and the organizational structure of consultations must be considered. As it will influence life events in their 20s such as pregnancy and childbirth, it is important to continuously educate young women on reproductive health through the school curriculum according to the stages of development and build awareness of the free vouchers at an early stage.
4.4. Results of Hypothesis Testing
1) The intervention group will score higher than the control group when tested on cervical cancer knowledge after one year: Partially validated due to significant increase in Healthy Lifestyles, Cervical Cancer Screening, and Cervical Cancer scores.
2) The intervention group will have more positive health beliefs than the control group regarding cervical cancer screenings after one year: Not validated, but a small-degree effect size was observed in Benefits, Seriousness, and Susceptibility scores.
3) The intervention group will show a higher rate of cervical cancer screenings than the control group after one year: Not validated. The screening rate of the control group was the same as the average among women in their 20s in Japan. However, the intervention group showed a rate of 30.3%, which was above the average.
5. Limits of Research and Future Tasks
The limits of this research were the small sample size and the fact that the selection of subjects did not include women from every part of Japan. It is necessary to verify with a larger number of subjects. Additionally, low socioeconomic attributes correlate to lower standards of health behavior and there is a tendency to see more success among more highly educated and higher income groups [27] [28]. Furthermore, in Japan the screening environment differs based on municipality. There is a need for the development of an education program which takes into account the background and education of the subjects as well as their environment.
6. Conclusions
The subjects of health education program implemented in this study to promote cervical cancer screenings among women in their 20s showed significantly higher knowledge and cervical cancer and healthy lifestyles in the intervention group than those of the control group. A small-scale effect size was observed in HBMSCCPST subscales and cervical cancer screening behavior. Additionally, a small-scale effect size was observed in knowledge and HBMCCPST subscales in the comparison of individuals who had a screening exam versus those who did not.
This suggests that the health education program was connected to knowledge retention after one year and was somewhat effective at influencing HBMSCCPST subscales and cervical cancer screening behavior. However, because the educational program was limited to one session and the sample size was small, it did not lead to precise results. The program must be reevaluated while considering regional characteristics, health behaviors, and economic elements in order to effectively bring about behavioral change.
Acknowledgements
We would like to thank the participants for their cooperation in making this study possible and the developers of the Health Belief Model Scale for Cervical Cancer and Pap Smear Test for graciously allowing us to reference their work. We would also like to express our gratitude for the guidance of Prof. Ayako Sasaki, Prof. Kumi Suzuki, Prof. Tomotaro Dote, and Prof. Yumiko Nakashita of the Osaka Medical College Department of Nursing Science. This study was funded with the assistance of the Health Science Center.