Application of the Probability Model for Starting Period to Initiate to Take Palivizumab by Prefecture Using National Official Sentinel Surveillance in Japan ()
1. Introduction
As generally known, even though respiratory syncytial (RS) virus infection is very common infectious disease for age 0 - 1, but its vaccination for RS virus infection was not available [1] [2] [3]. Instead of that, palivizumab were used for the premature infant or a high-risk infant with congenital heart disease. The targeted population need to shot it in every month during outbreak. However, recently outbreak pattern of RS virus infection has been varying year by year. Moreover, it also has substantial regional variation [4]. Therefore, the object of the present study was to develop early detection of the timing of that outbreak had started in each prefecture.
Recently, the probability model for starting period to initiate to take palivizumab was examined [5]. It used ORCA surveillance, which is daily reporting system for influenza, hand-foot-and-mouth disease, Erythema infectiosum, Pharyngoconjunctival fever, RS virus infection, measles, rubella and insolation from ORCA [6], which is an electronic medical claim system (http://infect.orca.med.or.jp/). ORCA was abbreviation for “Online Receipt Computer Advantage” which is online medical claim service produced and provided medical facilities freely by Japan Medical Association. ORCA was utilized in 17,174 medical facilities as of the end of September in 2019.
Even though the proposed probability model works well in nationwide, ORCA surveillance for RS cannot be break down to prefecture level due to limitation of reporting medical facilities. It reminded as about 200 facilities, and thus the probability model cannot work at prefecture level [5]. In Japan, national official surveillance for influenza has been performing at about 3000 sentinels, which is almost one of tenth of pediatric medicine, based on the Law Related to the Prevention of Infectious Diseases and Medical Care for Patients of Infections (The Infectious Diseases Control Law). We call it National Official Sentinel Surveillance for Infectious Diseases (NOSSID) [7]. However, since it reported the situation in the last week on Friday noon, it delays to report in public for 13 days at maximum. For detection of outbreak of RS virus infection, this delay might cause serious problem to initiate to take palivizumab. On the other hand, it was operated base on the law and thus it works well all prefectures in Japan. Because he previous research found that regional variation in outbreaks of RS among prefectures [4], prediction model by prefecture was necessary.
Therefore, we examined some feasibility and availability of earlier prediction model for outbreak of RS virus infection by prefecture using information of NOSSID.
2. Method
Study period was March 16th, 2011 to December 30th, 2018. We defined stating period to initiate to take palivizumab as 8 - 12 weeks before from the peak of outbreak. We dropped the data from the peak to the end of following March. We estimated whether week t is included starting period or not from April 1st to the peak of outbreak by the number of patients of RS virus infection on week t-k (k = 0, 1, 2, …, N), and its squared [5]. The largest lag of number of patient, N, was determined by that the coefficient of the number of patients on t-N was significant but insignificant on t-N from N = 0 step wisely. We applied the same specification, N, which is selected in the nationwide data to the prefectural data. We adopted 5% as significance level.
Then we calculated probability of starting period based on the estimation results. We suppose the criterion if the estimated probability was higher than this criterion, the model predicts the starting period on the week. The criterion was defined in each prefecture as the minimum the highest probability in each season among all five seasons. If the estimated probabilities in one week were the highest, the week was identified as the model predicted starting date. If the estimated probabilities in several weeks were higher than criterion, the first date was identified as the model predicted starting date. We identified the model was precise if predicted starting date locates during t − 12 to t − 8. Also we identified that it was too early if predicted starting date was before t − 12, and too delay if predicted starting date was before t − 8.
Additionally, we have to take delay in NOSSID as described above into consideration. The information in NOSSID on week t will be available on the week t + 2. Therefore, so as to start to take the drug during t − 12 to t − 8 weeks before the peak, the model should announce it on t − 14 to t − 10 weeks before the peak.
Season for RS virus infection was defined as from 1st April to the end of March in the following year. However, the end of season in 2018/2019 season was terminated on 30th December, 2018 due to data availability.
Ethical Considerations
Data from NOSSID was aggregated and de-linked from personal information related to patients and medical facilities: these are anonymous data. Moreover, these were published in general. Therefore, no ethical issues are posed by using these data for this study.
3. Results
Figure 1 showed the number of patients with RS virus infection to NSSID in nationwide. We selected N = 0 because the number of patient on t − 1 week were not significant in nationwide data. The estimated coefficient for number of patients on week t was 0.003 (0.000), for its squared was −6.08 * 10−7 (0.000) and constant was −3.28 (0.000). The number in parenthesis was p-value for each explanatory variable. Figure 2 showed estimated probability of the starting period in nationwide.
The identified criteria nationwide and by prefecture were summarized at the second column in Table 1. Moreover, Table 1 contains results of model prediction and actual starting period as “A”, “B” and “H”. “H” indicates the probability
![]()
Note: The rectangular area indicate starting period in each season.
Figure 1. The number of patients with RS virus infection to NSSID in nationwide.
![]()
Note: The rectangular area indicate starting period in each season.
Figure 2. Estimated probability of the starting period in nationwide.
![]()
![]()
Table 1. Results of the probability model for the starting period to start to take palivizumab in palivizumab nationwide and by prefecture by season.
Note: “H” indicates that the probability model predicted starting period precisely, “B” and “A” indicates that the probability model predicted it before or after of starting period. “H-” indicates that the probability model predicted last two weeks in starting period. “B+” indicates that the probability model predicted during the two weeks before starting period. “Criterion” was defined the smallest probability among the highest probability in each season in each prefecture.
model predicted the starting period precisely. “A” and “B” indicate its prediction was before and after starting period, respectively. Moreover, when we consider the delay in NOSSID into consideration, even though the model predicted before the starting period, it predicated the starting date within two weeks before the starting period, we can start to take in the starting period. Therefore, though the model fails to predict the starting period precisely, patients can start to take within the starting period. We denote this result as “B+.” Conversely, even though the model predicted the starting period precisely, if it predicted the starting date in the last two weeks of the starting period, the patients cannot start to take within the starting period. We denote this result as “H-.” Therefore, when we consider the delay in NOSSID into consideration, the patients can start to take in the case of the estimation results was “B+” or “H” but not “H-.”
In nationwide, criterion was estimated at about 60%. The last two seasons, the model predicted precisely the starting period. However, the first three seasons, the initial date when the estimated probability was higher than criterion were before starting period. In 2016 season, the initial date when the estimated probability was higher than criterion was after starting period.
The criterions among prefectures varied from 0.1996 in Nagasaki to 0.5826 in Tokyo. In total, the model predicted precisely in 47 cases. Conversely, the initial date when the estimated probability was higher than criterion were before starting period in 195 cases. Moreover, in 46 cases, the initial date when the estimated probability was higher than criterion was after starting period.
The most precisely predicted season was 2018 and the model predicted precisely in 16 of 48 prefectures or nationwide. Conversely, the worst predicted season was 2016, the model predicted precisely only one of 48 prefectures or nationwide. There were many prefectures where the model failed to predict precisely in all six seasons.
Conversely, when we consider the delay in NOSSID into consideration, the patients in 10 prefectures can start to take in the starting period in 2014. The following year was 2013 and the next was 2015.
In total, the model predicted the starting period precisely in 16.6% of all year and prefectures pairs. When we consider the delay in NOSSID into consideration, the patients can start to take in 14.9% of all year and prefectures pairs.
4. Discussion
The criterion which is defined as the lowest probability among the highest probability in each season was the highest in nationwide and following in Tokyo. The lowest was in Nagasaki and it was lower than 0.2. The lower criterion itself means badly fitness of the model. Moreover, the proportion of the model predicted precisely was remained about 15%. Unfortunately, the model failed to predict the starting period by prefecture in total.
The primarily reason might be that we applied the same formulation which is selected in nationwide to all prefecture, though using data and thus estimated coefficients were different for each prefecture. We might have to allow another specification in each prefecture. Moreover, though we defined the criterion as above, we have to define it more carefully with closing the situation in each prefecture. These examinations have to be our next challenge.
The secondly potential reason was shortcoming in NOSSID itself. Especially, it was weekly data, and thus it might not contain sufficient information to predict the starting period. In fact, some daily surveillance for RS virus infection such as ORCA surveillance [5] or (Nursery) School Absenteeism Surveillance System ((N)SASSy) [8] - [13] have sufficient power to predict the starting period using the similar model. If this reason was important, we have to give up developing the prediction model for the starting period in each prefecture. Because (N)SASSy or ORCA surveillance cannot provide sufficient information to predict in all prefectures, unfortunately.
5. Conclusion
We developed the prediction model for the starting period to take palivizumab. However, the results of the probability model were not good. Namely, the model predicted the starting period precisely only in 16.6%. When we consider the delay in NOSSID into consideration, the patients can start to take it only in 14.9%. Therefore, we have to develop more sophisticated model for prediction at prefecture level.