Use of Small Grants to Support and Enable Innovation in Teen Pregnancy Prevention

Over the years, the number of programs shown to be effective in preventing teen pregnancy has increased. While support continues to grow for evidence-based programs (EBP), gaps and disparities in current EBPs oblige the development of new and innovative approaches. Funded by the Office of Adolescent Health from the Department of Health and Human Services, the iTP3 project was charged with supporting and enabling the development of innovative teen pregnancy prevention programs. The iTP3 project, administered at Texas A&M University, awarded small grants of approximately $100,000 to 15 organizations across the United States to develop innovative programs to prevent teen pregnancy among underserved populations. This paper describes the funding and selection criteria of awardees, evaluation methods, characteristics of programs/ideas and corresponding organizations, capacity building assistance provided to program developers, and selected accomplishments. Small grant programs, such as that discussed here, can serve as models for others interested in working with program developers to create innovative programs.


Introduction
The issue of teen pregnancy has been addressed through numerous approaches, the most common being the implementation of evidence-based programs (EBPs).As many funding agencies require grantees implement EBPs to have the highest potential impact on their target population, there have been few oppor-tunities for program developers to create new and innovative programs to prevent teen pregnancy.The lack of opportunities to create innovative programs has led to a limited understanding of what makes a program innovative and how to create innovative programs.
The aim of this project was to identify mechanisms that support and enable the development of innovative teen pregnancy prevention programs and to identify characteristics of innovative programs.Before discussing the need for innovative program development in teen pregnancy prevention, we first examine existing EBPs and their strengths and weaknesses.Then, we describe methods used by the Innovative Teen Pregnancy Prevention Programs (iTP 3 ) project to support the development of innovative programs.We also note selected accomplishments of the overall iTP 3 project and our grantees.This article contributes to the growing literature on innovative program development at a time when most research and funding is geared toward existing EBPs.

Evidence-Based Programs
Evidence-based programs (EBPs) are common health promotion approaches to create positive behavioral change and/or outcomes among intended target populations (Powers et al., 2015).Due to positive effects demonstrated by research, support and appreciation for EBPs has increased in public health, especially to address the challenge of teen pregnancy prevention in the United States.Given public health concerns and negative impacts on youth achievement resulting from teen pregnancy (Hoffman, 2008;Perper et al., 2010;Penman-Aguilar et al., 2013), evidence-based interventions have gained ground as common strategies to decrease teen and unplanned pregnancy.
The interest in EBPs also arises from a growing inventory of evidence-based programs and approaches in teen pregnancy prevention.The first EBP list, created in 2007, provided a repository of effective sexual health programs, with evidence of reducing teen pregnancy and associated sexual risk behaviors (Douglas, 2007).Since then, federal funding initiatives through which the Department of Health and Human Services-Office of Adolescent Health (OAH), Family and Youth Services Bureau (FYSB), and Centers for Disease Control and Prevention (CDC) supported and tested programs, has led to a more current list of evidence-based interventions.This EBP list was developed through rigorous evaluation of programs using measures such as impact on teen pregnancy, teen birth, and sexually transmitted infections (STIs) (OAH, 2016a;OAH, 2016b).Such programs, supported by government agencies including OAH, Administration for Children and Families (ACF), and the CDC, demonstrate effectiveness in reducing teen pregnancies, STIs, and associated sexual risk behaviors (OAH, 2016a;Maness & Buhi, 2016).
Among EBPs, most programs were designed to be implemented in middle and high schools, clinics, after school or community-based organizations, and other specialized settings.Approaches varied to include a range from abstinence-based K. L. Americans and Hispanic and/or Latinos (OAH, 2015).Most programs on the teen pregnancy prevention EBP list impact change at the individual-level by focusing on participants' knowledge, skills, attitudes, values, and individual access to resources (Goesling et al., 2014).However, it is important to recognize and address factors that contribute to adolescent pregnancy including: interpersonal dynamics in relationships with partners; social norms, including the onset of sexual behaviors; and systematic factors, such as availability and access to contraceptives (Douglas Jr. & Fenton, 2013).
From 2010-2014, OAH funded organizations to replicate and evaluate teen pregnancy prevention programs proven to be effective or considered "promising" (Kappeler & Farb, 2014).The early support of promising programs was an initial investment in advancing teen pregnancy prevention programs.While the field of teen pregnancy prevention has advanced scientific understanding of implementing and replicating EBPs (Koh, 2014;Margolis & Roper, 2014), gaps still exist in fulfilling target population needs, delivering programs in various settings, using different levels of intervention, and offering non-traditional programs.New delivery methods and targeted programs are necessary to reach teens at higher risk for experiencing teen pregnancy but not reached through traditional programming.

Need for Innovative Program Development
Innovation has a place in adolescent health program planning beyond its current application of program adoption and dissemination (Wilson et al., 2017).Fostering and supporting innovation is necessary to keep up with the advances in human behavior and technology, thus the question, "how can the field advance programs that are innovative and engage the target population and impact adolescent pregnancy or birth rates?" remains.
Given the ongoing gaps and disparities in existing EBPs, OAH funded two projects in 2015 to foster and support innovative approaches to teen pregnancy prevention (Kappeler & Farb, 2014).One project, Innovation Next, focused on technology-based innovations in teen pregnancy prevention, while the other project, the Innovative Teen Pregnancy Prevention Programs (iTP 3 ) project, focused on, "how can we foster innovation in teen pregnancy prevention programs that are innovative in design and approach to impact populations at greatest risk?".

The iTP3 Project
Administered at Texas A&M University, the iTP 3 project used small grants to Small grant programs, such as that discussed here, can serve as models for others interested in working with program developers to ideate and create innovative ideas, that if successful may be tested in a controlled environment.This also represents one approach for establishing a system that actively supports early stages of program development and the recognition that not all program ideas should be invested in from a long-term, high dollar perspective.

Methods
The Office of Adolescent Health (OAH) funded the Innovative Teen Pregnancy Prevention Programs (iTP 3 ) project through a grant from 2015-2018.The iTP 3 team oversaw the formal selection of small grant recipients to develop innovations in teen pregnancy prevention.The process began with disseminating a formal request for proposals (RFP) to a national audience.Interested applicants submitted complete proposal materials through an electronic portal.Applicants had the opportunity to apply through a traditional grant narrative format or a web-based format to ensure that applicants not well versed in traditional grant applications could still apply.This was due to the thought that smaller, more nimble organizations may have more leverage to break from traditional programmatic norms.
All applications were screened for eligibility once received, then reviewed a K. L. knowledge in various aspects of teen pregnancy prevention and adolescent health.Reviewers identified the top applications using a review protocol.Utilizing a tiered approach, recognizing the need for innovation in multiple areas and at various ecological levels, applicants were selected for funding in Cohort 1 of the iTP 3 project.
Ultimately, the successful applicants addressed the needs of an underserved population or planned to develop a program for a unique setting.Additional innovative components and approaches to teen pregnancy prevention were considered.The first cohort of grantees included 15 organizations across the United States (see Figure 1) funded out of 59 applicants.The majority of the small grants were awarded to community-based or health care organizations.All grantees received an award of $100,000 over 12 months to support and enable innovative teen pregnancy prevention programs for the duration of the small grant.

Capacity Building Assistance
Project teams were encouraged to view their work plan as an iterative document and update it as needed throughout the year.This allowed the teams freedom to listen to their target population and needs assessment results to create a targeted and innovative program, rather than being held to their initial program idea.
Throughout the funding period, grantees received capacity building assistance

Evaluation
The iTP 3 team used a collaborative evaluation framework to encourage partnerships between the iTP 3 project team, small grant recipients, and funders to design and implement the program evaluation (Fluhr et al., 2004).The participatory approach ensured the evaluation would capture the most important data-with the least burden on project teams-while still providing meaningful information about the implementation and outcomes of the iTP 3 program.
In order to understand and describe the iTP 3 project, process and outcome measures were used in the evaluation.It is important to note that iTP 3 aimed to enable and support early teen pregnancy prevention innovations and emphasized implementation and measurable outcomes, not adolescent focused research or outcomes.Thus, the majority of the evaluation focused on implementation and quality improvement measures, which allowed the iTP 3 team to monitor progress and document the project's effectiveness in meeting its stated goals.
Throughout the funding year, grantees provided the iTP 3 team monthly project updates and provided progress or changes to their initial work plans.Using this information, iTP 3 tracked the progression in the program development process.The monthly updates also provided iTP 3 with insight regarding capacity building assistance needs for grantees at both an individual and group level.
Given that most of the small grant programs were in different stages of development, they were responsible for evaluating their own progress and outcomes.Evaluation plans varied and covered a range of domains, as did the programs.Evaluation questions included characteristics about implementation and adaptation, barriers, facilitators, implementation, networks, outcomes, partnerships, reach, sustainability, and performance measures as included in their program plans.For example, some grantees were in the needs assessment stage and conducted interviews and focus groups as part of their evaluation, whereas other programs had a solid plan and utilized multiple data collection strategies.

Results
To understand the scope and range of the iTP 3 -funded projects and gain insight into potential for innovation and characteristics of innovative settings, the programs are categorized below based on their stage of program development, setting, and target population.Generally, projects falling into category one engaged their target population(s)

Innovative Program Ideas and Stages of Development
to better understand and explore needs in preventing teen pregnancy, and some began with a program idea to engage their target population for further refinement and development.Category two projects began formative program assessments with their target populations and stakeholders to adapt program materials and resources, selected appropriate fidelity measures, created a data collection plan, and conducted preliminary cost analyses.Projects ready to develop a feasibility testing protocol and collect pilot data of their program related to cost, exposure, implementation, and changes or effects on their target population by implementing small scale projects fell into category three.

Description of Funded Organizations and Program Setting
iTP 3 funded various types of organizations to develop innovative teen pregnancy prevention programs as shown in Table 2. Cohort one organizations received awards to develop teen pregnancy prevention programs and were not specifically intended to be the site for program implementation.Table 2 shows the type of organizations funded as well as the proposed program setting.While most programs were intended to be implemented at a physical location, some included a mobile technology piece for participants to access separately.Some programs did not select a location/setting during the application and onboarding stage, so the program could be further developed based on the target population, and accessible and supportive sites.The geographic location of awardees spanned the United States, as shown in Figure 1.

Characteristics of the Target Populations Served by the Program
By addressing various levels of intervention, a wide range of target populations were engaged in (or the focus of) program development.Most programs intended to target populations that went beyond the adolescents, to include practitioners, parents/caregivers, support staff, community members, trusted mentors, and/or adults.The variety of target populations represented is shown in Table 3 and Table 4.

Level of Intervention
The request for proposals for iTP 3 grantees prioritized applications proposing new and innovative approaches that exceeded individual level change.As current teen pregnancy prevention efforts primarily target individual-level change (Farb & Margolis, 2016), iTP 3 emphasized the importance of innovative programs targeting multiple levels, including individual, interpersonal, organizational, community, policy, and system-level change.The levels of intervention targeted by each program are shown in Table 5.

Selected Accomplishments
The purpose of the iTP 3 project was to support and enable innovative program development in various stages of development for underserved populations.
Each of the characteristics highlighted above shows a piece of the story for what makes each program innovative.Through the iTP 3 mini grants, several accomplishments were evident at the end of cohort one.Following are a few selected accomplishments that illustrate the effectiveness of the iTP 3 mini grant model in fostering innovation.
One of the most broad-reaching accomplishments is the incorporation of youth in the program development process.One of the goals of iTP 3 was to ensure the programs met the target populations' needs.According to program design experts and innovative fields such as human centered design, gaining insight from the youth for these teen pregnancy prevention projects was critical K. L. ( Luma Institute, 2015;Vechakul et al., 2015;Li et al., 2018).One example of gaining deep insight from the youth included a video-voice project in which participants showed their perspective of the issue at hand through making videos.
Other programs utilized innovative strategies to gain insights from the youth they worked with through nontraditional interviews and focus sessions.
Another accomplishment included the ability to create and establish new partnerships, as well as ties to systems approaches.One program working with individuals with disabilities expanded geographic area to gain insight from individuals with disabilities themselves, parents/caregivers of individuals with disabilities, and other adults supporting this target population.Another program increased partnerships that allowed youth greater access to healthcare, while another focused on a systems level approach with foster care staff.
Other programs intended to institutionalize reproductive health care.For example, one hospital system planned to ensure that sexual and reproductive health becomes an important part of the standard care of practice within clinics.This is an example of advancing systems thinking and recognizing that policies, systems, and environments influence important contextual factors and go beyond individual level programs.

Discussion
The iTP 3 project successfully achieved its goals and objectives in working with cohort one grantees to support and enable the development of innovative teen pregnancy prevention programs.By working closely with iTP 3 , innovative teams identified challenges and additional priority areas for subsequent years of the project.After work began with cohort one, the iTP 3 team set priorities for selecting additional innovative teams and identifying types of capacity building and technical assistance needed with this kind of project.The team identified a need to shift capacity building, professional training, and innovation development as this project continued.Nonetheless, the activities completed with cohort one supported iTP 3 's main goal-to support and enable innovation in teen pregnancy prevention.
The iTP 3 project continued to expand capacity building opportunities with innovative teams and facilitated professional connections and referrals to provide unique opportunities for organizations and teams to enhance their program development by operating with a design thinking approach that can impact community-based systems.Allowing opportunities for people to utilize their creative and design thinking skills and to iterate solutions for their team is an essential core for the successful development of innovative programs.Cohort one of the iTP 3 project brought together diverse professionals sharing an interest in innovative program development and provided working knowledge on how to improve the efforts to enable innovative programs.This analysis of innovative program characteristics provides new insight into the development of innovative programs, both in general and within teen pregnancy prevention.To date, the majority of research on innovative health pro-K.L.  (Rogers, 1995;Wandersman et al., 2008).The concept of providing mini grants with an opportunity and flexibility to iterate programs provides promise into new directions for the field.Additionally, there is promise in looking to other related fields for ideas on progressive program development.
For example, the Socio Ecological Model, which recognizes intervening at various levels of intervention, has guided public health programming for nearly thirty years (McLeroy et al., 1988).However, evidence-based teen pregnancy prevention programs still tend to focus at the individual level (Wilson et al., 2017).Breaking from this individual-level paradigm provides a new way of thinking and approaching programs.
Most of the programs proposed during cohort one of the iTP 3 project focused on innovation based on the setting or at the target population level.Through the course of working with the grantees there was a transition to innovation focusing on the design approach for program development and focusing on systems-level approaches.

Implications for Practice
The use of small or mini grants has been utilized in other public health efforts to aid in training and dissemination (McNeal, 2012;Kegler et al., 2015).Small grants to support and enable innovation in teen pregnancy prevention programs provide an opportunity to explore the real challenges of program development in teen pregnancy prevention.iTP 3 was charged with emphasizing innovation, but through the small grant efforts, the iTP 3 team learned how to foster innovation through a flexible process and identify factors that make a program innovative.Additional exploration on whether small grants support innovation in program development and the process for developing innovative programs could provide meaningful insight.Given the current focus on program implementation and fidelity in the teen pregnancy prevention field, the impact of using design thinking in program development could also provide important insights.
Ultimately the larger project to support and enable innovation in teen pregnancy prevention provided the opportunity for the first cohort to propose ideas to expand the evidence-based programs in teen pregnancy prevention.The initial cohort proposal of innovation focused around geography and target population.Through the efforts of selecting programs, working with organizations, engaging with program teams, and evaluating the iTP 3 capacity building support, the iTP 3 project was successful in transitioning programs to further consider new ideas around program design and systems level approaches, beyond those initially proposed.

Funding Statement
The project described was supported by Grant Number TP2AH000046 from the Figure 1.Map indicating state location of iTP 3 cohort 1 funded organizations.
iTP 3 awarded organizations with funding to support program ideas indifferent stages of development (Table1).The program developers indicated what category of development they believed best suited to their project.The stage of development was confirmed through review by the Innovation Advisory Committee and discussions between the iTP 3 team and program developers.Upon Wilson et al.
Wilson et al.

Table 1 .
Program idea and stage of development.
 5 Develop a program to train & support resident assistants on college campuses to serve as sexual health educators to college students. 6 Develop a mobile and interactive learning platform to improve sexual health outcomes and promote healthy relationships among pregnant and parenting teens in which teens can connect with a provider nearby and other teen parents. 12 Develop an intervention in which LGBTQ youth of color create public service announcements through video voice that are meaningful and relevant to their experiences and needs in preventing teen pregnancies, to disseminate through social medial.funding, projects were categorized into four stages of development.Categories of program development including: 1) an idea that had not been developed or transitioning an idea into a promising program; 2) preparing programs for implementation; 3) feasibility testing and/or preparing to pilot program; and 4) final stages of program development.None of the Cohort 1 projects fit in the final stages of program development (category 4).Further, projects were restricted from entering rigorous evaluation as this funding supported development of new programs.

Table 2 .
Funded organization type and program setting proposed.
HC-Healthcare; RE-Research and Evaluation Institute; HD-Health Department; NP-Non-Profit; S/U-School/University; HC-Healthcare; FCA-Foster Care Agency; SC-School Campus; CBO-Community Based Organization; CC-College Campus; M-Mobile.

Table 3 .
Table 3 describes the target population directly served by the innovative program, while Table4describes the target population to be impacted by the program.The target population(s) to be impacted are not exhaustive, it is merely the primary demographic group the programs' goals are directed to-Characteristics of target population to be directly served by innovative program.
wants.The advisory groups met regularly with program developers to discuss program goals, materials, activities, implementation logistics, anticipated challenges, marketing and recruitment, etc.K. L.Wilson et al.DOI: 10.4236/ce.2018.9111171631 Creative Education

Table 4 .
Wilson et al.Characteristics of target population to be impacted by innovative program.

Table 5 .
Level of intervention proposed for the innovative program.
Wilson et al.