The Development and Application of the RAND Program Classification Tool

The Development and Application of the RAND Program Classification Tool: The RAND Toolkit, Volume 1

Joie D. Acosta
Gabriella C. Gonzalez
Emily M. Gillen
Jeffrey Garnett
Carrie M. Farmer
Robin M. Weinick
Copyright Date: 2014
Published by: RAND Corporation
Pages: 72
https://www.jstor.org/stable/10.7249/j.ctt5vjw88
  • Cite this Item
  • Book Info
    The Development and Application of the RAND Program Classification Tool
    Book Description:

    The RAND Program Classification Tool is an instrument containing questions and response options across eight key domains that allows for the consistent description of programs in the same content area. Such data can help program portfolio managers compare programs, avoid duplication, and target technical assistance. Developed for psychological health and traumatic brain injury programs, the tool has broader applicability to other content areas.

    eISBN: 978-0-8330-8486-6
    Subjects: Psychology, Management & Organizational Behavior, Health Sciences

Table of Contents

  1. Front Matter
    (pp. i-ii)
  2. Preface
    (pp. iii-iv)
  3. Table of Contents
    (pp. v-vi)
  4. Figures and Tables
    (pp. vii-viii)
  5. Summary
    (pp. ix-xii)
  6. Acknowledgments
    (pp. xiii-xiv)
  7. Abbreviations
    (pp. xv-xvi)
  8. CHAPTER ONE Introduction
    (pp. 1-4)

    Between 2001 and late 2010, more than 2.2 million service members were deployed in support of military operations in Iraq and Afghanistan, including Operation Iraqi Freedom, Operation Enduring Freedom, and the newest phase of operations in Iraq, Operation New Dawn (U.S. Department of Veterans Affairs Office of Public Health and Environmental Hazards, 2010). Despite the recent drawdown of troops in Iraq, service members have experienced significant mental health problems because of the increased pace of deployments, longer deployments, and frequent redeployments over the past decade. Among those who had been deployed to Iraq and Afghanistan as of October 2007, approximately...

  9. CHAPTER TWO Development of the RAND Program Classification Tool
    (pp. 5-12)

    The R-PCT was developed concurrently with RAND’s catalog of psychological health and TBI programs and the development of criteria for including programs in the catalog. As such, the development process was iterative and fluid.

    The development process consisted of three activities: (1) a targeted literature review; (2) consultation with experts in the fields of program evaluation, psychological health, social services, and military health; and (3) preliminary reliability testing to assess the tool’s usefulness. For each activity, we constructed and then revised the tool in response to comments and critiques from experts. Table 2.1 itemizes the methods used to answer each...

  10. CHAPTER THREE User’s Guide for Applying the RAND Program Classification Tool
    (pp. 13-34)

    This chapter focuses on answering the guiding question, “How can DCoE and other stakeholders with an interest in describing and comparing programs make use of this tool?” The final tool includes 16 questions, covering the eight program characteristics described in Chapter Two. Table 3.1, the R-PCT tool, shows each of these characteristics, along with the corresponding questions and response options. The R-PCT in Table 3.1 is tailored to DoD programs addressing psychological health and TBI but can be adapted to describe and compare other programs. This chapter introduces the tool and provides a user’s guide to applying the R-PCT with...

  11. CHAPTER FOUR Potential Uses of the RAND Program Classification Tool
    (pp. 35-38)

    The R-PCT has a number of potential uses across a wide variety of organizations and activities besides military programs addressing psychological health and TBI. Individuals who manage portfolios of programs (e.g., government agencies, foundations, and intermediary and grant-making organizations) could apply the R-PCT to the programs they manage using the instructions in Chapter Three. Following are examples of how to analyze the data to describe the status of evaluation activities across all programs, to identify common barriers faced by programs, to describe changes in programs over time, and to compare programs across two or more R-PCT characteristics.

    Looking at even...

  12. CHAPTER FIVE Conclusions and Next Steps
    (pp. 39-42)

    Consistent metrics are necessary to enable comparisons of the characteristics of multiple programs in the same content area. The R-PCT supports such comparisons by defining the key characteristics of programs, providing questions and response options for gathering information, and allowing users to systematically aggregate data on multiple programs.

    Although the tool was initially developed for use by RAND as part of an independent assessment of DoD-funded psychological health and TBI programs, it has broader applicability to describing and characterizing programs that provide other types of services in other content areas, including

    development of program goals (target populations, program objectives, and...

  13. APPENDIX A Sources Used in RAND Program Classification Tool Development
    (pp. 43-46)
  14. APPENDIX B Definitions of a “Program”
    (pp. 47-48)
  15. APPENDIX C Inter-Rater Reliability Statistics for the Application of the RAND Program Classification Tool
    (pp. 49-50)
  16. APPENDIX D Training External Raters to Use the RAND Program Classification Tool
    (pp. 51-52)
  17. APPENDIX E Glossary
    (pp. 53-54)
  18. References
    (pp. 55-56)