11

Teenage Pregnancy Prevention: Research and

Demonstration Programs and Personal Responsibility

Education Program (PREP)U.S. Department of Health and Human Services

Office of Adolescent Health & Administration on Children, Youth

and FamiliesApril 23, 2010

1:00-3:00pm ET

22

Agenda for Today’s Call Welcome and Introductions Overview of the Funding Announcement Program Expectations Application Contents Application Submission Instructions Review and Selection Criteria

Asking Questions During the Webinar

4

Printing the Webinar Slides

55

Purpose of Today’s Call Review the Teenage Pregnancy Prevention:

Research and Demonstration Programs and Personal Responsibility Education Program (PREP) Funding Opportunity Announcement, including the purpose, eligibility requirements, and how to apply for funds

Will not be answering questions specific to individual applications

66

IntroductionsOffice of Adolescent Health Evelyn Kappeler, Acting Director Alice Bettencourt, Acting Deputy Director Allison Roper, Public Health Analyst Amy Margolis, Public Health Analyst Jennifer Gannon, Management Analyst Miryam Gerdine, Public Health Analyst

Administration on Children, Youth and Families Debbie Powell, Acting Associate Commissioner Stan Chappell, Director, Division of Research and Evaluation Seth Chamberlain, Social Science Research Analyst

Office of Grants Management Karen Campbell, Director

Overview of theOffice of Adolescent

Health & Administration on

Children, Youth and Families

88

Office of Adolescent Health (OAH)

Consolidated Appropriations Act, 2010 directed that a new OAH be established

Responsible for implementing and administering new grant program to support evidence-based teen pregnancy prevention approaches

Coordinates adolescent health programs and initiatives across the U.S. Department of Health and Human Services

99

Administration on Children, Youth, and Families (ACYF)

Administers the major Federal programs that support: Social services that promote positive growth

and development of children and youth and their families

Protective services and shelter for children and youth in at-risk situations

Foster Care, Child Abuse/Neglect Prevention, and Adoption Assistance programs

Manages the Personal Responsibility Education Program

10

Role of Grants Management

Official signatory for obligating federal grant funds

Official signatory for all grant business

Monitor all business/financial transactions on grants for compliance to Federal Regulations (including interpretation of Federal Regulations)

Maintain official grant files

11

U.S. Department of Health and Human Services

12

Office of Public Health and Science

ASSISTANT SECRETARY FOR HEALTHHoward Koh, MD, MPH

Principal Deputy AssistantSecretary for Health

Wanda Jones, DrPH

Senior Advisor to the ASHRosemarie Henson, MPH, MSW

Regional HealthAdministratorsRegions I-X

National Vaccine Program Office

Deputy Assistant SecretaryBruce Gellin, MD, MPH

Deputy AssistantSecretary for Health(Healthcare Quality)

Don Wright, MD, MPH

Office of the Surgeon GeneralSurgeon General

Regina Benjamin, MD, MBAVADM, USPHS

Office of Disease Prevention and Health Promotion

Deputy Assistant SecretaryPenelope Slade-Sawyer, PT, MSW

RADM, USPHS

Office of Population AffairsDirector

Susan Moskosky(Acting)

Office on Women’s HealthDirector

Frances Ashe-Goins, RN, MPH(Acting)

President’s Council on Physical Fitness & Sports

Executive DirectorShellie Y. Pfohl, MS

Office of Research IntegrityDirector

Don Wright, MD, MPH(Acting)

Office of HIV/AIDS PolicyDirector

Christopher Bates, MPA

Office of Minority HealthDeputy Assistant Secretary

Garth Graham, MD, MPHLCDR, USPHS

Office of Commissioned Corps Force Management

DirectorDenise Canton, JD, RN

RADM, USPHS

Deputy AssistantSecretary for Health

(Science and Medicine)Anand Parekh, MD,

MPH

Office of CommunicationsDori Salcido

Office of Adolescent HealthDirector

Evelyn Kappeler(Acting)

Office for HumanResearch Protections

Director Jerry Menikoff, MD, JD

Office of Public Health and Science

13

Administration on Children and Families

1414

Teenage Pregnancy Prevention Initiative Consolidated Appropriations Act, 2010 (Public

Law 111-117)- $110 million

$75 million - replicate program models proven effective through rigorous evaluation (Tier 1)

$25 million - research and demonstration grants to develop, replicate, refine, and test additional models and innovative strategies (Tier 2)

$10 million - training and technical assistance, evaluation, outreach, and additional program support activities

15

Personal Responsibility Education Program (PREP)

Patient Protection and Affordable Care Act (Public Law 111-148) - $10 million

Implement innovative youth pregnancy prevention strategies, and

Target services to high-risk, vulnerable, and culturally under-represented youth populations, including:

Youth in foster care, homeless youth, youth with HIV/AIDS, pregnant and parenting women who are under 21 years of age and their partners, and youth residing in areas with high birth rates for youth

Tier 2 Review & Award Process

16

OAH & ACYF Jointly

Announce Availability of FundsReview Applications

Select Successful Grantees

OAH

Awards and Monitors TPP Funds

($15 - $25 million)

ACYF

Awards and Monitors PREP Funds

($10 million)

Introduction to TPP: Research and

Demonstration Programs and PREP

Funding Announcement

1818

Purpose of Funding Announcement

To support research and demonstration programs that will develop, replicate, and test additional models and innovative strategies for preventing teenage pregnancy and target services to identified populations

1919

Target Populations Youth ages 10-19 at program entry

PREP projects should and TPP projects may target high-risk, vulnerable and culturally under-represented youth populations

Pregnant women and mothers under age 21 and their partners (PREP only)

All Applicants: Are encouraged to serve specific priority populations as

long as there is a sound rationale with supporting data Should clearly define target populations by age groups and

priority populations, when appropriate, within geographic areas with high teen birth rates

2020

Who’s eligible to apply? “Funds made available … shall be for making

competitive contracts and grants to public and private entities” (Consolidated Appropriations Bill, 2010) Nonprofit organizations For-profit organizations Small, minority, and women-owned businesses Universities and colleges Research institutions Hospitals Community-based organizations Faith-based organizations Federally recognized or state-recognized

tribal governments State and local governments State and local school districts Political subdivisions of States

2121

Funding Ranges

Range A - $400,000 to $600,000 per yr Range B - $600,000 to $1,000,000 per yr

* Applicants may only apply for one funding range under this announcement.

* Applicants may choose to opt out of consideration for funding from a specific funding stream (TPP or PREP)

2222

Cost-Sharing or Matching Neither cost-sharing nor matching are required

Funded programs should build on, but not duplicate, current Federal, state, local, or community programs and coordinate with existing programs and resources in the community

While not required, applicants are welcome to supplement this effort with additional or non-federal resources

Any written commitment of institutional support from the applicant and its collaborators may demonstrate a greater potential of success and sustainability of the project

2323

Award Information Number of awards: Up to 45

Type of Award: Cooperative Agreements

Funding Range: $400,000 - $1,000,000

Project Period: Up to 5 years

Start Date: September 2010

Applicants may only submit one application for consideration

2424

Any Questions?

2525

Asking Questions & Printing the Slides

Program Expectations

2727

Overview of Program Expectations

Implement a program intervention likely to demonstrate a change in sexual behaviors

Explain potential to provide evidence of results and how the intervention could be replicated

Address the target population Ensure age-appropriateness, and scientific and medical

accuracy Engage in phased-in implementation period Collect and report performance measurement data Adhere to evaluation expectations

2828

Program Interventions Focus on interventions most likely to demonstrate

change in sexual behaviors

Interest in applications that propose to address gaps in the field of teenage pregnancy prevention Programs with some evidence of effectiveness Significant adaptations to an evidence-based program

identified as eligible for Tier 1 TPP funding (Appendix A) Innovative programs for 18-19 year olds Program approaches for priority populations Programs to reduce repeat-pregnancies and target pregnant

and parenting women ages 21 and under Other innovative program models, including use of new social

media

2929

Significant Adaptations to Tier 1 Program Models

Significant adaptations are changes to the program or curriculum activities that alter one or more core components of the program, including but not limited to: Changing sequence of activities Adding activities Addressing additional risk and protective factors Replacing videos Modifying instructional activities Using other models/tools that cover same ground

Such changes are sought in applications under this funding announcement

3030

Document the Potential to Demonstrate Evidence

Identify the evidence or research base Document the intervention using a logic model and

identify the core components Document significant adaptations (if modifying an

existing model in Appendix A) Document the program/curriculum in a manual,

including staff training Document changes made for quality improvement

based on piloting Document any adjustments made during

implementation Include plan for disseminating intervention findings

3131

Medical Accuracy & Age-Appropriateness

Funded programs will need to ensure that information provided is age appropriate, and scientifically and medically accurate

Materials will be reviewed by OAH or ACYF prior to implementation to ensure medical accuracy

Full curricula should NOT be submitted with the application. The review and approval process will occur during the planning phase of the first grant year

3232

Phased-In Implementation Period

Funded recipients will engage in a planning, piloting, and readiness period for the first 6 to 12 months of funding

During this period, grantees will: Continue to assess needs and resources Finalize goals, objectives, and logic model Assess program fit Build organizational capacity Finalize implementation plans Pilot test program

The length of the phased-in implementation may vary by grantee depending on implementation readiness

OAH or ACYF approval is required before full-scale implementation

3333

Evaluation Strategies Monitoring and reporting on program

implementation and outcomes through performance measures

Rigorous independent grantee-level evaluation design unique to grantee project

Federal evaluation of a subset of all grantees

3434

Performance Measures Developed by OAH and ACYF during first year of

program All grantees will be expected to collect and report

on common set of performance measures to assess program implementation and outcomes

Training and technical assistance will be provided Anticipated categories for measures:

Output measures Fidelity/adaptation Implementation and capacity building Outcome measures Community data

3535

Grantee-level Evaluation Rigorous independent grantee-level evaluation design

unique to proposed program intervention Use either random assignment or quasi-experimental

design HHS will review and assess proposed evaluation designs HHS approval required before implementing evaluation

plan HHS will provide training & TA on evaluation – general &

project specific.

See Appendix C in the FOA for detailed guidance

Budget 20-25% to support evaluation activities

3636

Federal-level Evaluation of TPP

Funded grantees will be required to participate in Federal evaluation, if selected, and agree to follow all evaluation protocols established by HHS or its designee

Selected grantees will no longer be expected to have a grantee-level evaluation and will be required to redirect their evaluation budget to support activities related to the Federal level evaluation

Decisions regarding participation in Federal evaluation expected by end of planning year Anticipate selecting approximately 12 grantees across TPP

(Tiers 1&2) and PREP

3737

Access to Health Care and Other Services

As appropriate and allowable, applicants may provide teenage pregnancy prevention related health care services and/or make use of referral arrangements with other providers

38

Items Requiring OAH or ACYF Approval

Approval required for: Medical accuracy of curricula and program

materials Evaluation plans Full-scale implementation

Full curricula should NOT be submitted with the application. Program materials will be submitted for review and approval during the phased-in implementation period of the first grant year.

3939

Any Questions?

40

Asking Questions During the Webinar

Application Contents

4242

Contents of Application Submission

Abstract (one-page)

Project Narrative (no more than 50 pages) Organizational Capability Statement Project Management Need Statement Intervention to be Tested and Project Approach Target Population Program Goal(s), Objectives, and Activities Work plan and Timetable Collaborations and Description of MOUs Performance Measurement Evaluation

Appendices

Budget Narrative/Justification

No more than

100 pgs

4343

Project Abstract (1 page) Clear, concise description of the project that

can be understood without reference to other parts of the application. Should include: Project title Applicant contact information Type of organization applying Overarching goal(s) Description of intervention to be implemented Geographic area to be served Target population

4444

Project Narrative Formatting

Double-spaced 8 ½ x 11 inch (letter-size) pages 1-inch or larger margins on top, bottom, and

both sides At least 12 point font All pages, charts, figures, and tables should

be numbered Maximum length for Project Narrative = 50

pages

4545

Project Narrative:Organizational Capability

Current capability to organize and operate effectively and efficiently

Decision-making authority and structure Past experience in implementing teen pregnancy

prevention programs Past experience and accomplishments in creating

partnerships with organizations/agencies to implement programs or systems to address teen pregnancy prevention

How various sites and outside resources will be managed logistically and programmatically

4646

Project Narrative:Project Management

Plans to govern and manage the execution of the overall program

Governance structure, roles/responsibilities, operating procedures, composition of committees, workgroups, terms and associated leaders, and communications plans

How plans and decisions are developed and documented and issues/risks managed

Specify mechanisms to ensure accountability across community participants and incremental progress in achieving milestones

4747

Project Narrative:Need Statement

Geographic area to be served Benefit for the target population Incidence of teen births in the area Documentation of sexually transmitted disease

rates, socio-economic conditions including income levels, existing services and unmet needs in the service area

Unique challenges and barriers facing proposed population

4848

Project Narrative: Intervention to be Tested and Project

Approach Program intervention and appropriateness for

population to be served Rationale for choosing proposed intervention & how

approach is based upon previous experience and community needs

Implementation plans and site (s) Rationale for proposed adaptations to existing

evidence-based program model in Tier 1, if applicable Plans to provide directly, and/or by referral, teenage

pregnancy prevention related health or social services Coordination with existing services in the area Staff training and program management Request, if desired, to opt out of one of the funding

streams – TPP or PREP

4949

Project Narrative:Target Population

Describe target population using statistical data and other community factors

Provide realistic estimates of overall number of program participants and number participating in proposed project site(s)

Describe expected number of participants during first and second year of implementation; break out by age, race, and ethnicity

Describe age appropriateness of proposed intervention

5050

Project Narrative: Program Goal(s), Objectives, and

Activities Specific program goal(s) and up to 6 outcome

objectives

SMART objectives S – Specific M – Measurable A – Achievable R – Realistic T – Time-framed

Logic Model (5-year) – visual representation of relationships between proposed resources, planned activities, and desired outputs and outcomes

5151

Project Narrative:Work plan & Timetable

Detailed work plan and timetable for the five year project period

Work plan is a concise, easy-to-read overview of goals, strategies, objectives, measures, activities, timeline, and those responsible

Within the work plan include each activity associated with the implementation, the proposed time frame for the start and completion of each activity, and the responsible staff

5252

Project Narrative:Collaborations

Detail intent to coordinate with other community agencies and not duplicate existing efforts

Describe expertise and capabilities of other partnering agencies

Identify community stakeholders

Detail the specific nature of involvement and level of commitment of each stakeholder

Include MOUs from each participating site, stakeholders, and outside resources (if applicable) in the Appendices

5353

Project Narrative:Performance Measurement

Monitor progress on uniform set of process and outcome performance measures

Describe capability to implement monitoring and reporting systems to aid in internal data collection around metrics for successful achievement of performance measures

5454

Project Narrative:Evaluation

Demonstrate capability to conduct a rigorous local, independent evaluation

Provide clear and fully developed evaluation plan in accordance with criteria in Appendix C of the FOA

Describe program intervention to be tested; theory upon which intervention is based; experimental design; proposed evaluation questions; data collection instruments; and plans for sampling, data collection, and data analysis

Describe how data will be used for ongoing program improvements

Describe plans to ensure confidentiality of data Include a MOU and CV from the independent evaluator

in Appendices

5555

Project Narrative:Federal Evaluation

Successful applicants must agree, if selected, to participate in a Federal evaluation, conducted by an independent contractor through a separate competitive award process

5656

Appendices Resumes for Project Director and detailed position

descriptions Program logic model (see the Application Kit for

example) Memoranda of Understanding from all participating sites Memorandum of Understanding with independent

evaluator Curriculum Vitae of independent evaluator Memoranda of Understanding from all partners Organizational chart Applicant organization’s Federal-Wide Assurance Proof of nonprofit status, if applicable

5757

Budget Narrative/Justification

State the funding range requested

Outline proposed costs that support all project activities

Thoroughly describe how the proposed costs are derived Breakdown each line item and provide an

explanation of the costs Personnel should include salary per person and

percent of time each person will spend on grant

Specify the source of in-kind contributions (if applicable), and how the valuation of that contribution was determined

5858

Budget Information: Explanation of Line Items for

424aa. Personnelb. Fringe Benefits- based on bylaws of

organization; taxes; social security; insurance benefits; percent varies by organization

c. Travel- include an annual meeting & 3 regional trainings

d. Equipment- any items over $5,000 per unite. Supplies- items under $5,000 per unitf. Contractual- include independent evaluatorg. Construction – not allowed h. Other

59

Funding Restrictions Funds may not be used:

For building alterations or renovations, construction, fundraising activities, political education or lobbying

To supplant/replace any non-Federal or other Federal funds that would otherwise be made available for the activity proposed in the application

To supplant on-going or usual activities of any organization involved in the project

To purchase or improve land, or to purchase, construct, or make permanent improvements to any building

To reimburse pre-award costs

59

6060

Other Required Application Forms

Application for Federal Assistance (SF 424) Budget Information for Non-Construction

Programs (SF-424a) Project Abstract Project Narrative Attachment Form Budget Narrative Attachment Form Assurances for Non-Construction Programs (SF-

424B) Disclosure of Lobbying Activities (SF-LLL) HHS Certifications (08-2007)

6161

Any Questions?

62

Asking Questions During the Webinar

Application Submission Instructions

6464

Opt-out Provision Applicants may only submit one application

under this FOA

Applicants will be considered for both the TPP and PREP funding unless the applicant specifies that it only wants to be considered for funding under one program

If you choose to opt out, do so in the Intervention to be Tested and Project Approach section of your application.

6565

Receipt Deadlines Letter of Intent – May 10, 2010

Include descriptive title, funding range, and contact information

Submit via fax to (240) 453-2801 or via email to oah.gov@hhs.gov

Applications Electronic submission – June 8, 2010 by

11:00pm ET Paper submission – June 8, 2010 by 5:00pm ET

6666

Electronic Submissions Grants.gov- http://www.grants.gov/

GrantSolutions- https://www.grantsolutions.gov/

Register well in advance

Must be submitted no later than 11:00pm Eastern Time on June 8, 2010

All required hardcopy original signatures and mail-in items must be received by the Office of Grants Management Grant Application Center no later than 5:00pm Eastern Time on June 9, 2010

Applications are not considered valid until all electronic components, hardcopy original signatures, and mail-in items are received

6767

Paper Submissions Must be received no later than 5:00pm Eastern Time

on June 8,2010 Address all materials to:

Office of Grants ManagementOffice of Public Health and Science (OPHS)Department of Health and Human Services (DHHS) c/o Grant Application Center1515 Wilson Blvd., Suite 100Arlington, VA 22209 Attention: Office of Adolescent Health

Include the following on the lower left corner of your mailing envelope: “ATTENTION: OFFICE OF ADOLESCENT HEALTH – TIER 2 (NEW GRANT APPLICATION)”

6868

Application Tracking Form Applicants are strongly encouraged to

complete and submit this form at the time of application submission Fax to (240) 453-2801, or Email to oah.gov@hhs.gov

Used by the OAH and ACYF to track grant applications

Form available in Appendix D of FOA or on the OAH website under “Current Grant Announcements” - “Application Kit”

6969

Application Tips If submitting a hardcopy by mail or hand

delivering… Do NOT staple or otherwise bind your application Do NOT send any extraneous materials such as

videos, books, etc. Do NOT send double-sided information/ pamphlets Do NOT submit the proposed curriculum or

educational materials DO double space on 8 ½ X 11 paper DO submit an original and two copies

7070

Application Tips Read the entire FOA and application kit BEFORE

writing Write the One Page Summary - AFTER the entire

narrative is complete Read the review criteria Read the application instructions Do NOT exceed the 50 page limit for the project

narrative OR the total page limit of 100 pages for the full application

Turn in application no later than 5pm ET (hard copies) or 11pm (electronic copies) on June 8, 2010 Allow time for any unforeseen difficulties with the

on-line application process, etc.

7171

Application Tips Remember that the FOA is the primary guide

to programmatic requirements

Follow what the FOA says

Review & Selection Criteria

7373

The Application Review Process: Review Criteria

Project Approach and Work Plan (35 points) Organizational Capacity and Experience (25

points) Evaluation Plan and Performance

Measurement (20 points) Project Management and Staffing (15 points) Budget (5 points)

74

Selection Process Objective Review Committee

Expert peer reviewers Federal Staff

Applications reviewed according to the published review criteria

75

Final Award Decision Criteria

Score and rank order given by the Objective Review Committee

Availability of funds Representation of programs across communities,

including varied types of interventions and evidence-based strategies

Geographic distribution of projects Inclusion of communities of varying sizes Inclusion of populations disproportionately

affected by teenage pregnancy Feasibility of evaluation plan

76

Notification of Funding Notice of Grant Award notifies successful

applicant of selection

Includes any conditions on the award

Tier 2 Review & Award Process

77

OAH & ACYF Jointly

Announce Availability of FundsReview Applications

Select Successful Grantees

OAH

Awards and Monitors TPP Funds

($15 - $25 million)

ACYF

Awards and Monitors PREP Funds

($10 million)

7878

Any Questions?

79

Asking Questions During the Webinar

8080

Thank you! Office of Adolescent Health

Website - www.hhs.gov/ophs/oah Email – oah.gov@hhs.gov Phone – (240) 453-2806

Administration on Children, Youth and Families Phone – (202) 205-8102

Office of Grants Management Email – karen.campbell@hhs.gov Phone – (240) 453-8822