Applying the ADDIE—Analysis, Design, Development, Implementation and Evaluation—Instructional Design Model to Continuing Professional Development for Primary Care Physicians in Saudi Arabia ()
Received 18 July 2016; accepted 12 August 2016; published 15 August 2016
1. Introduction
Physicians and other team members in primary health care are expected to work with their colleagues independently to provide required services to their patients and their families. Graduation from accredited medical colleges and postgraduate medical residency programs provide the knowledge and skills necessary to enter the profession and practice with patients [1] . As professionals, family physicians are obliged to remain current on advances and trends in medicine and health care delivery [2] . This is usually achieved through engagement in a variety of activities that constitute continuing professional development (CPD) [3] . Professional development, also called staff development, is the process of improving staff capabilities through access to education and training opportunities in the workplace, often provided by an outside organization or by watching others performance on the job [4] . Professional development helps build and maintain staff members’ morale and is thought to attract higher quality staff to an organization [5] .
In the medical context, continuing medical education (CME) refers to the same concept, i.e., providing education to maintain and improve professional competency among health care workers [4] . Strategies used to develop CME have been evaluated and often criticized as ineffective for achieving its intended goals [6] [7] . Performance evaluation of health employees, on the other hand, is a mandate of all organizations including hospitals, as well as primary care and community health services for monitoring staff performance, motivation, and professional development. Participation in CPD and CME could be used in performance evaluation, in addition to other work performance indicators such as staff attendance, clinical skills and work-related attitudes. However, most staff evaluation is based on pre-employment agreements, expectations, and/or job definitions [1] .
Instructional design (ID) is a systematic method of development of education and training programs for improved learner performance [8] . Over the last decades, practitioners have developed a number of models for instructional design (ID) [9] . An ID model is a set of main elements and tasks within a representation of real environment, developed to help educators and instructional designers incorporate fundamental elements of ID principles into a manageable process [9] [10] . The ID model is built upon some basic concepts about learning and instruction: firstly, learning takes place within an individual, involving cognitive and motor functions that lead to behavior. Secondly, instruction is the formal act of facilitating learning. One must therefore design the learning experience/instruction in such a manner that it will optimize learning. The development of appropriate ID approaches is one way to optimize learning through the design of the instructional process [8] . Instructional design is the key tool to establish systematic CPD that can ensure professional improvement, credibility and transparency to the community by analyzing, designing, developing, implementing, and evaluating the CPD education program [11] .
Such education programs must provide high quality training built on strategic planning using an effective ID process. The CPD challenge is how to implement an effective program and performance evaluation that is valid, reliable, and practical for primary care physicians based on decisions about what should be expected from the physician, who is already certified, works in solo clinics most of the time, and is expected to manage a variety of patient problems.
Many professional instructional designers have applied the generic ADDIE framework [10] as a standard model for technology-based education. ADDIE is an instructional systems design model that presents a series of iterative steps for building effective education and training in five phases: analysis, design, development, implementation and evaluation.
2. Purpose
The purpose of this study was to introduce a professional development program for primary care physicians using the ADDIE (Analysis, Design, Development, Implementation, Evaluation) instructional design model to improve primary care physicians’ clinical performance.
3. Methods
The study involved 37 primary care physicians working in the Family and Community Medicine Department of Prince Sultan Medical Military City in Riyadh, Saudi Arabia. This department is one of the largest departments of this medical city and comprises several community centers with different numbers of physicians and target populations. Physicians are ranked in the department according to their background, medical affiliations, and experience in the categories of consultant, senior registrar, registrar, and senior house officer. The last two categories are the ones that constitute the focus of this study.
The analysis phase of the ADDIE model started by dividing 37 doctors into four smaller, mostly equal groups. The main program objective was to improve the approach to patients’ clinical management WHAT KIND?, enhance doctor-patient communication skills and support doctors on their decision for investigations and prescribing rationally rationalizing resources?. Before beginning the program, a survey was sent to all participants to inquire about their perceived performance gaps, their main problems during work in the clinics, and their preferred style of learning (Appendix 1). Rounds were scheduled to observe doctors' consultation skills based on a patient consultation observation model (Appendix 2).
For the design, development, and implementation phases, six sessions were conducted over six months with each group on different medical topics. MORE DETAIL ON THESE PHASES? SOME DESCRIPTION?
Before beginning the program, a survey was sent to inquire about doctors’ performance gaps, their main problems during working in the clinics, and the style of learning they would prefer. Rounds were scheduled to observe doctors’ consultation skills based on a consultation observation model with patients (Appendix 1). The design, development and implementation phases are summarized as follows. Six sessions were conducted over six months with each group on different medical topics .Facilitators of the sessions were chosen from the departments in which consultants and senior trainers had more experience and/or qualifications in dealing with common family medicine problems. The sessions were designed to be interactive and case-based discussions were prepared on the topics listed (Table 1).
Cases were discussed in an interactive manner among facilitators and candidates and materials were provided if a topic required reading or preparation ahead of time. Some topics required presentation of slides, others
![]()
Table 1. Topics included in the case-based discussions.
required dummies for examination, and case scenarios with role plays were used to highlight communication issues (Table 2).
Facilitators of the sessions were chosen from the departments in which consultants and senior trainers had more experience and/or qualifications in dealing with common family medicine problems. The sessions were designed to be interactive, and case-based discussions were prepared on the topics listed in Table 1. Cases were discussed in an interactive manner among facilitators and candidates, and materials were provided if a topic required reading or preparation ahead of time. Some topics required presentation of slides, others required dummies for examination, and case scenarios with role-plays (e.g., see Table 2) were used to highlight communication issues.
Evaluation of the program was done using multiple instruments. An evaluation form was used to evaluate individual sessions and facilitators. At the end of the six-month program, participants completed a final problem-based multiple-choice assessment, a form-based evaluation of the program, and a self-assessment questionnaire. Focus group discussions were conducted for both participants and trainers to explore their feelings and perceptions about the program activities.
4. Results
Twenty-six out of the 37 physicians attended the sessions over the six-month period and completed both the final knowledge test and the self-assessment test. The remaining 11 participants were removed from the sessions to meet service needs or did not complete the full six months’ attendance due to leaves.
Figure 1 summarizes scores on the final knowledge assessment. The average mark was 35 correct answers out of 50 questions, ranging from 24 to 39; the majority of participants scored between 34 and 40.
Table 3 summarizes the results of the self-assessment questionnaire. Six participants’ self-assessments were removed from the analysis because they attended less than three sessions. For 16 out of the 23 topics discussed, at least 50% of participants rated their improvement as a result of attending the group sessions and discussions as “great”. Dermatology topics, however, showed less improvement.
![]()
Figure 1. Physicians’ scores on the final test of 50 items about clinical topics attended (n = 26).
![]()
Table 2. Sample case used in the CPD sessions.
![]()
Table 3. Physicians’ self-assessments of their level of improvement (N = 20) as a result of attending the six-month course*.
*Six participants did not complete this self-assessment form.
In addition to the above-mentioned assessments, a focus group discussion was conducted to explore physicians’ feelings and perceptions about the effect of being enrolled in these kinds of activities as a form of professional development. Participants made positive comments regarding reviewing the topics from the clinical point of view and reflecting on the problems that they faced in their daily work. One of the participants voiced her opinion as “We have the knowledge background from basic education, but sometimes we need to review and share different views”. Another said that “It’s is a brilliant idea to be pulled out of work once a month for the purpose of continuing education and professional development”.
However, participants were concerned about the issue of the final appraisal being part of their annual employee review, as a result of participating in this program. Participants often questioned the need for the final test and queried the weight of the final assessment on contract renewal. In addition, the trainers who facilitated the sessions were concerned about the variability between their usual teacher-directed teaching styles and their learner-centered group facilitation experience.
5. Discussion
This study highlighted our valuable experience with the process of physicians’ continuing professional development in primary care. Application of the ADDIE model through a pre-designed, structured small-group review and discussions of relevant clinical topics led to better identification of physicians’ professional performance. The final objective assessment of clinical knowledge was identified as lower than expected for a practicing physician; the average score was 35/50 (70%). This finding could be attributed to problems in the physicians’ clinical knowledge application due to workload issues or maybe a result of employee selection. Analyzing this further could be fruitful for the organization and patient care.
Participants’ evaluations of individual sessions identified issues such as low satisfaction scores for the dermatology sessions, where findings did not indicate significant improvement. Exploring the study participants’ and trainers’ views regarding the activity highlighted issues needing improvement such as the quality of training and employee appraisal.
Evaluating the effectiveness of different models of CPD is not new to the literature. As mentioned earlier, CPD is required for all physicians for reasons including improving performance and quality of care [12] . The workloads and structure in primary care mandate a different design and development process. The formats of conducting national and international events such as large audience conferences and big workshops might not always fulfill the purpose. Instructional design is the key tool to establishing a systematic CPD process that can ensure professional improvement, credibility and transparency to the community by analyzing, designing, developing, implementing, and evaluating the CPD education program [11] .
6. Conclusion
Applying a structured instructional design model for creating professional development program for physicians is a fruitful, relevant experience in primary healthcare. We recommend that this study be repeated on a wider national and international scale.
Declaration of Interest
The authors report no declarations of interest.
Appendix 1: Needs Assessment
Dear colleague:
As an endeavor to promote doctors’ performance in the division, we seek your collaboration as a member to actively participate in the doctors’ on-the-job training program. In order to tailor the program to the needs and demands of the doctors, we ask you to complete this form. The results will help us to build up a program that responds to your needs and helps enhance your competencies and performance.
Name: (optional)
Doctor’s title: Registrar Resident
Have you had formal training in family medicine: Yes No
How many years of training have you had in family medicine? Years: ____
How many years of experience in family medicine do you have? Years: ____
Do you have any special area of interest? Yes No
Please specify _______________________________________
Have you had any training in the doctor-patient interaction/ commutation skills? Yes No
Regarding the previous question, what type of training have you had?
Formal Non-formal Other (please explain) ______________________________________
Plan of activities:
What is your preferred frequency for this program? Daily Twice a week Weekly
What is/are your preferred form/s of learning?
Would you prefer practical sessions? Yes No
Would you like to have sessions on special procedures and hands-on skills? Yes No
Others (please specify) ____________________________________________________________
In what areas of your daily work do you feel that you need improvement?
In what areas would you like to contribute during this program?
Thank you
Appendix 2
Consultation observation sheet1.
1Adapted from the COT Consultation Observation Tool (Royal College of General Practitioners n.d.) [13] .
NOTES
![]()
*Corresponding author.