Exercise Evaluation Guides for Public Health Emergency Preparedness

Abstract

The ultimate test of the proficiency of emergency responders and the systems in which they operate is an actual disaster. Fortunately, disasters happen rarely, so responders must find alternate ways to practice their skills. Emergency response exercises are a well regarded means to accomplish this practice. However, to fully realize the value of exercises the performance of the responders participating in the exercise must be evaluated. Currently, few standardized instruments exist to guide the process of exercise evaluation. The exercise guides with which most exercise evaluators are familiar are published by The Department of Homeland Security (DHS). In this article we present two standardized instruments, known as Exercise Evaluation Guides (EEGs). In particular, these EEGs are intended for use in evaluating public health preparedness in the areas of 1) epidemiologic surveillance and investigation and 2) isolation and quarantine. What distinguishes these EEGs from those published by DHS is an emphasis on planning as a pre-requisite to successful response and performance based on quality, instead of timeliness or percent of effort completed.

download the pdf
Download the pdf

Suggested Citation

Bradshaw, Christine, and Thomas Bartenfeld. “Exercise Evaluation Guides for Public Health Emergency Preparedness.” Homeland Security Affairs 5, Article 1 (September 2009). https://www.hsaj.org/articles/95

INTRODUCTION

The ultimate test of proficiency for emergency responders and the systems in which they operate is an actual disaster. Fortunately, disasters happen rarely, so responders must find alternate ways to practice their skills. The best forms of practice are exercises and drills that simulate reality as closely as practicable. 1 “The true value of exercises lies in the opportunities they offer to practice skills and make mistakes in a low-cost, low-risk, low-consequence environment compared with real catastrophes.” 2 To fully realize this value, the ability of individuals to perform their jobs and to coordinate their efforts during an exercise must be evaluated. Though evaluation is essential, standardized instruments to assess how well responders perform during an exercise are relatively new.

The purpose of this article is to provide standardized instruments called Exercise Evaluation Guides (EEGs) for two public health functions: Epidemiologic Surveillance and Investigation and Isolation and Quarantine. These EEGs are intended to aid judgment (1) of public health responder performance using the guides’ check-lists and (2) of emergency response plans using the guides’ planning sections. In addition to providing guidance for evaluators regarding actions they should expect to observe from responders, the EEGs present (1) performance measures that measure quality, as opposed to more commonly available measures of timeliness, or percent of effort completed and (2) planning elements to evaluate adequacy of response plans.

The guides are particularly useful for evaluation because they rely on observations made by an independent third party, as opposed to assessment made by self-report. Evaluation done by an independent third party, who is neither playing in the exercise nor conducting it, is preferred to self-reported assessment because the former likely yields less biased, more credible performance data.

The initial sections of this article offer background information about EEGs, describe the methods used to create them, explain their component elements, and discuss their intended use. The EEGs, performance measures, and relevant planning elements are then provided as appendices: (1) Epidemiologic Surveillance and Investigation (hereafter called Epi), Appendix A; and (2) Isolation and Quarantine, Appendix B.

BACKGROUND

The public health EEGs presented here are based on the Department of Homeland Security (DHS) concept of capabilities. The DHS provides a definition of capabilities in operational terms: Responders become capable of performing critical tasks to expected levels of proficiency through adequate planning, equipping, training, organizing, and exercising that includes evaluation and corrective action. Capabilities-based planning has been used by the military to plan for flexible configuration and deployment of resources under conditions of great uncertainty. The main question for each capability is: If you can help manage an incident, what are you capable of doing? DHS defines thirty-seven capabilities in its current version of the Target Capabilities List (September 2007). 3 Two public health capabilities from the list are addressed in this article: (1) Epidemiologic Surveillance and Investigation and (2) Isolation and Quarantine. Thus, the related public health EEGs are named accordingly.

These public health EEGs are also consistent with the DHS Homeland Security Exercise and Evaluation Program (HSEEP). According to DHS, HSEEP is a “capabilities and performance-based exercise program that provides a standardized methodology and terminology for exercise design, development, conduct, evaluation, and improvement planning.” 4 The Exercise Evaluation Guides offered by DHS are also called EEGs. The public health EEGs derive their name from the DHS EEGs. Both the DHS EEGs and the public health EEGs presented in this article aid the process of evaluation.

How These Public Health EEGs Differ from the DHS EEGs

The Planning Section

Each of the two public health EEGs presented in this article has a section to help with planning, a requirement for exemplary performance during real or mock disasters. Ideally, emergency planners anticipate the needs of responders by examining lessons learned from past events, projecting how a response might unfold, inventorying available resources, and projecting resource shortfalls. Industry “best practices” are often well represented in effective plans. However, the process of planning is frequently cited as being more valuable than having a written plan. Planning promotes responder collaboration, whereas plans do not necessarily assure it. Such conventional wisdom notwithstanding, by using the planning checklists evaluators can detect strengths and potential vulnerabilities in preparedness. Evaluators can conduct a pre-exercise document review to help determine whether planning is adequate. If a jurisdiction has paid careful attention to planning, it typically has written evidence to substantiate its efforts. Also, if player performance does not meet expectations, evaluators can consider planning deficiencies when analyzing the reasons why performance is not as expected. For example, in the Isolation and Quarantine EEG, Appendix B1: Planning, if a jurisdiction’s planners diligently identified alternate quarantine facilities before a pandemic, they will likely have current memoranda of agreement in place with those facilities to expedite transfer of legal authority to use the facility in an emergency.

Performance Measures based on Quality

Exercise evaluators must be able to determine whether players’ actions and decisions are (1) appropriate (the right action), (2) timely (done at the right time), and (3) of acceptable quality (done the right way) to achieve the intended outcomes. This article suggests measures of performance based on quality, namely quality decision-making and quality work products. The performance measures in the DHS EEGs tend to emphasize evaluation based on timeliness and occasionally on percent of effort completed.

Similarities to the Homeland Security Exercise and Evaluation Program (HSEEP) and the DHS EEGs

Like the DHS EEGs, the public health EEGs are modular. Modularity allows exercise designers to combine different activities and critical tasks from within and between instruments in a “mix and match” fashion to create an evaluation specific for the exercise being developed. DHS describes the process at their HSEEP website, which links to a tool called the EEG Builder. 5 The DHS tool enables emergency planners to “build an EEG” by selecting activities and tasks pertinent to the exercise they want to conduct in order to test the objectives they set forth in the exercise. These public health EEGs are created with the same process in mind. For example, if the objectives of an exercise are to (1) test the protocols for public health officials to assess an ill passenger arriving from a foreign country that is experiencing an outbreak of human cases of novel influenza and (2) determine whether isolation or quarantine are needed for the passengers and crew, the exercise designers might want to select and combine relevant activities and critical tasks from both public health evaluation instruments: Epidemiologic Surveillance and Investigation and Isolation and Quarantine. In contrast, the activity in the Epi EEG entitled “Human Health Threat Analysis for Exposures to Toxins” is not pertinent to a scenario that depicts a known contagious disease. Thus, this latter activity would likely not be incorporated into the given exercise.

METHODS

Creating EEGs requires three types of expertise: (1) subject matter, (2) exercise development and design, and (3) evaluation.

Subject Matter Expertise

In creating these public health EEGs we acquired the first type of expertise initially from small groups of five to ten subject matter experts at the Centers for Disease Control and Prevention (CDC). This cadre of experts described the major categories of activity and related critical tasks that comprise their jobs. The categories and associated tasks became the major elements of the EEG detailed in the Results section. Their discussion was based on the fifteen DHS National Planning Scenarios, 6 which cover an array of natural and man-made disasters (e.g., an outbreak of pulmonary anthrax or a pandemic of influenza).

Next, this work was vetted with larger groups of ten to twenty state and local subject matter experts, including representative members from the Council of State and Territorial Epidemiologists, the National Association of County and City Health Officials, the Association of State and Territorial Health Officials, and the International Society for Disease Surveillance. The expertise of these public health professionals was obtained at nationally convened meetings and by requests for commentary through their professional associations. Face-to-face meetings were followed by phone and email consultation to ensure that the instruments accurately captured in words what the experts think and do in practice. In addition, we searched the published literature to get even more detail and to assure that the evaluation instruments are consistent with how experts have handled real incidents in their particular disciplines. The expert subject matter content in the EEGs is the result of all the above consultations and deliberations.

Our goal was to strike a balance between having enough accurate content without having too much unnecessary content. Inaccurate content or omissions of critical steps can lead to poor performance and misunderstanding of public health’s role, but too much unnecessary content prevents the instruments from being practical.

Exercise Development and Design and Evaluation

We acquired the second type of expertise, exercise development and design, from CDC staff who are DHS-certified Master Exercise Practitioners. We obtained the third type of expertise, evaluation, from CDC experts in evaluation practice. Collectively, these individuals helped transform the subject matter expert content into action steps that can be observed and evaluated during an exercise.

RESULTS

The Elements of an EEG

The public health EEGs are organized like the DHS EEGs, namely Capability Description, Capability Outcome, Activities, Critical Tasks, and Observation Keys. 7 Figure 1 shows the general hierarchy of these elements; Figure 2 gives a narrative example.

image

Figure 1. Evaluation elements and relatedness to the mission

Mission: Manage the Outbreak

Capability: Epidemiologic Surveillance and Investigation (Appendix A)

Activity 2: Case investigation to confirm the outbreak

Activity Description: Determining to whom the event is occurring, what is the nature of the event, and when and where it is occurring (i.e., the who, what, when, where, and how).

Performance Measure: Health Alert Network messages must be of minimally acceptable quality (applies also to health alerts generated by jurisdictions that have the same intent and purpose as official Health Alert Network alerts). For quality criteria, see Appendix A2, Activity 2, Work Product Criteria.

Critical Tasks and Observation Keys

Confirm the existence of an unusual occurrence or event

  • Case report data interpreted to determine meaning and implications; epidemiologic clues evaluated
  • Syndromic surveillance data analyzed using aberration detection (if available and appropriate for use in given situation)
  • Alternate explanations considered (e.g., increased clinician awareness as a result of recent media attention to certain diseases, new physicians or clinics in the vicinity, changes in diagnostic methods.

Figure 2. Narrative example of hierarchy depicted in Figure 1.

Description of EEG Elements

Capability Description

The capability description is a broad overview of the resources (i.e., personnel, equipment, supplies) that contribute to management of a given emergency. It is what the capability offers to the disaster.

Capability Outcome

The capability outcome is the anticipated result of the collective effort provided by the Capability.

Activities

Activities are category headings for critical tasks that share a similar purpose. For example, an overall capability might include the public health activities of surveillance, case investigation, and mitigation and containment. Activities are subdivided into critical tasks.

Performance Measures (Epi EEG only)

Performance can be measured in terms such as time (e.g., the ambulance arrived within ten minutes of dispatch), accuracy (e.g., the triage nurse accurately categorized the patient’s level of care required as “immediate” because the patient had life-threatening injuries), and quality (e.g., the attending physician administered the correct treatment). The Epi EEG suggests some performance measures which might serve as standards for evaluating the quality of decisions and work products.

Critical Tasks

Critical tasks, indicated with a checkbox (q), describe steps that are deemed critical and, therefore, must be done to achieve the expected outcome of the Activity and, ultimately, the capability. Critical tasks are usually performed in sequence, in the preferred order typically followed by subject matter experts.

Observation Keys

Observation keys, indicated with a checkmark (P), are subdivisions of each critical task, intended to help evaluators identify whether responders have met important indicators for each critical task. They do not cover every action to be taken by responders; rather, they provide supplemental information as needed to enhance the usefulness of the instrument.

How the two Public Health EEGs Differ From Each Other

Epidemiologic Surveillance and Investigation

Only the Epi EEG includes some suggested performance measures, which may be used to judge the quality of responder performance. These performance measures offer criteria for determining the quality of certain decisions made and work products generated in the course of executing this capability. Quality is important because responders in other capabilities rely heavily on the decisions and work products handed off to them from the Epi capability. To conduct their own work, they need these products to be of acceptable quality. Disaster management literature repeatedly cites the hand-offs, or interfaces, between capabilities, as exceptionally prone to failure if the work that links them is inadequate or missing. 8 When decision making is faulty, work products are of poor quality, or work products do not get handed off to the correct, linked capability the emergency response system becomes disorganized.

Because these performance measure criteria are complex with multiple variables to consider for a single decision, we included the criteria as an appendix to avoid repeatedly diverting the reader’s attention from the flow of logic and sequence of critical tasks in the body text. The performance measure is described under its related activity, and the associated criteria are located in Appendix A2: Criteria for Performance.

Isolation and Quarantine

In contrast to the Epi EEG, the Isolation and Quarantine EEG embeds decision-making criteria in the body text. The decisions presented in this instrument frequently have only two variables [e.g., Patient needs hospital-level care (yes/no)]. Including simple criteria in the body text does not disrupt logic and sequence.

Though the decision-making criteria are simple, the Isolation and Quarantine EEG contains many decisions. For example, when a public health professional is determining whether a patient’s home, or alternate facility, is a suitable site for isolation or quarantine, that professional must determine whether the site has basic necessities such as utilities, ventilation, showers, and food preparation areas. If essential needs cannot be met, the public health responder assessing the suitability of the site should judge the site unacceptable. The evaluator can ask the public health official to “think out loud” and voice the criteria he is considering when determining site suitability. The evaluator can then use the criteria as a guide to ascertain whether the official is considering those criteria that experts expect to be considered.

DISCUSSION

How to Use the Public Health EEGs

The public health EEGs are primarily for use in operations-based (e.g., functional, full-scale) exercises, but they can guide the evaluation of discussion-based (e.g., tabletop) exercises as well. These exercise types are more fully explained in the DHS, HSEEP Policy and Guidance; Volume I, HSEEP Overview and Exercise Program Management. 9 The public health EEGs can also be used to de-brief following routine disease outbreak investigations (i.e., routine after-action reviews) to assess the quality of decisions made and actions taken during the investigations. The EEGs are intended for use as part of a comprehensive program to assess preparedness. Evaluations of preparedness depend on other factors such as quality of exercise design, appropriateness of exercise scope, and assumptions made by planners (e.g., use of volunteers to distribute assets from the Strategic National Stockpile assumes that the volunteers will show up).

Not all elements of an EEG apply to every scenario or to every phase of a scenario. Subject matter experts are needed to create EEGs and their knowledge and judgment are equally needed to ensure correct application of the content. Their expertise is essential to all phases of exercise development. Experts should help to set the objectives for the exercise, define the exercise scope, ensure the accuracy of the scenario and its applicability to the proposed exercise, participate as evaluators, and guide the creation and implementation of a corrective action plan to improve response. In addition, when developing exercises for public health it is always prudent to consult published guidance, such as that available from the Centers for Disease Control and Prevention, as well as other expert literature, in order to assure that the exercise materials reflect the most current and accurate information available. This is likewise the case for any responder discipline and its expert knowledge base.

The EEGs obviate the need to memorize essential steps. Just as experienced pilots use preflight checklists to ensure review of critical steps before take-off, these public health EEGs prompt evaluators to look for certain evidence of planning before an exercise and particular decisions, actions, and work products during an exercise. As evaluators examine plans and observe exercise play they can take notes directly on a printed copy of the EEG. They can record their observations guided by descriptions of elements they should expect to see.

The Relationship Between EEGs and After Action Reports/Improvement Plans (AAR/IPs)

Purposes of evaluation include the improvement of organizational and individual performance. 10 Exercises are typically followed by close examination of the actions taken and decisions made by responders to determine if the exercises’ objectives were met. If the objectives were not met, emergency responders and planners try to identify areas needing improvement. They especially review deficiencies in planning, organizational structure, training, equipment, and personnel staffing. Their findings are captured in After Action Reports (AAR), and, subsequently, in Improvement Plans (IP) to address deficiencies.

According to the previously mentioned DHS EEG Builder:

Exercise Evaluation Guides (EEGs) have been developed to assist in the evaluation of exercises by providing evaluators with consistent standards and guidelines for observation, data collection and analysis, and report writing. Using the EEGs can help you develop stronger and more consistent After Action Report/Improvement Plans (AAR/IP). EEGs provide exercise evaluators with a manageable tool with which they can collect data during an exercise, in a format allowing the easy transfer of information to the AAR/IP. 11

Limitations of the Public Health EEGs

These public health EEGs are only a starting point for exercise evaluation. One limitation of these EEGs is that their content has been vetted, but they have not been field tested. Another limitation is their use in highly controlled and applied settings has not been systematically studied. Their strengths and weaknesses can best be discovered by using them during actual exercises.

An Agenda for Further Research

These public health EEGs are offered for current use, but they are also offered to excite research in the field of exercise evaluation. Further research is proposed in the following areas.

Setting Performance Standards

For these public health EEGs, experts suggested standards for appropriate action and acceptable levels of quality. Performance standards for timeliness are not yet defined. More experience is needed to verify that the activities and tasks described in these instruments are the correct and necessary ones to manage a variety of public health emergencies. Additional study is also needed to set performance standards for timeliness and to further define standards for quality. Ideally, standards to define the actions that responders might typically take and the decisions that they are likely to make in various scenarios would already be worked out, vetted, tested, and agreed upon. Such is not the case for many disciplines, and certainly not for public health, a relative newcomer to the arena of emergency response.

Assigning Weights

Furthermore, these EEGs will be most useful as assessment tools when the activities and tasks described in them are weighted and scored. Weights and scores reflect the relative contribution of each element toward achieving desired performance outcomes. For example, when the Epi EEG is used to evaluate performance during an outbreak investigation, are the tasks “Confirm the diagnosis” and “Create an interim case definition” equally critical? If not (e.g., if one task is more critical to identifying cases, contacts, and risk factors than the other) the more critical task should receive more weight in the assessment instrument. Expert judgment is probably the highest level of rigor currently available. Nevertheless, experience through widespread use should enable assigning realistic weights and scores to the EEG elements.

The Need for Standardized Exercises

To determine how well prepared one jurisdiction is compared to another, standardized exercises are needed. In a standardized exercise each jurisdiction conducts the exercise using the same scenario, under a standard set of conditions and a standard set of assumptions. Using standardized exercises evaluators can create an evaluation instrument specifically tailored to the exercise. In this manner, the entire “test” – the exercise and its evaluation guide – is uniform. Standardizing the “test” enables evaluators to judge performance more fairly and equitably across jurisdictions and responders. The most intriguing aspect of a standardized exercise, however, is that standardization enables the ability to model the effects that different responder decisions and actions have on the exercise objectives. When responders in an exercise can see the real impact their decisions and actions have on outcomes, the simulated experiences presented in exercises begin to more closely resemble reality. 12

CONCLUSION

Public health responders recognize that exercises are a time-tested means to practice skills and prepare for real events. However, standardized instruments to guide the process of public health exercise evaluation are recently introduced and un-tested. Nevertheless, these EEGs serve an important purpose to assure that critical planning and performance elements are addressed and evaluated in any exercises involving the two capabilities presented in this article. There are no absolute “gold standards” to evaluate public health’s capabilities for all hazards under all conditions. Therefore, one cannot possibly overstress how essential are subject matter experts, emergency planners, exercise developers, and responders who have played in many exercises to the creation of more realistic exercises and better evaluation tools. Even these public health EEGs warrant further examination to determine if they are the best design as evaluation instruments. We anticipate that exercise evaluation will come to be an area of expertise in its own right, leading subject matter experts, exercise designers, and evaluation professionals into closer collaboration to enrich the field of exercise performance evaluation.

Christine C. (Chris) Bradshaw, DO, MPH, MBA is a medical officer and the lead epidemiologist in the Biosurveillance Coordination Unit (BCU) of the Coordinating Office of Terrorism Preparedness and Emergency Response (COTPER) at the U.S. Centers for Disease Control and Prevention (CDC) in Atlanta, GA. As a member of the BCU, Dr. Bradshaw is responsible for developing the National Biosurveillance Registry for Human Health (NBRHH). She previously served as a medical officer in the Coordinating Office of Terrorism Preparedness and Emergency Response (COTPER), Division of State and Local Readiness at the CDC. Dr. Bradshaw is certified by the American Board of Medical Specialties in preventive medicine and psychiatry. She possesses an undergraduate degree in chemistry and graduate degrees in medicine, public health, and business administration. Dr. Bradshaw can be contacted at mailto:zti0@cdc.gov or cbradshaw@cdc.gov.

Thomas A. Bartenfeld, PhD is a behavioral scientist with CDC’s Coordinating Center for Health Promotion (CoCHP). His current activities focus on program capacity and capability-building and establishing frameworks for judging program success. Prior to his current assignment with CoCHP, Dr. Bartenfeld was with the CDC’s Office of Program Planning and Evaluation, working with CDC programs on a variety of program evaluations, providing technical assistance for cross-CDC evaluations, and serving on CDC evaluation and research work groups.

Disclaimer

The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.

Acknowledgements

The authors extend special thanks to the following for allowing us to use their work extensively: Tomás Aragón, Wayne Enanoria, and Arthur Reingold; Conducting an outbreak investigation in 7 steps (or less), used in the Epidemiologic Surveillance and Investigation EEG; and David Heyman, Model Operational Guidelines for Disease Exposure Control, used in the Isolation and Quarantine EEG.

The authors also express their gratitude to the following persons who provided helpful suggestions and feedback, reviewed the manuscript, or supported the extensive devotion of our time to this work: Curtis R. Mast, MS, MEP (Master Exercise Practitioner) Centers for Disease and Prevention (CDC), Coordinating Office of Terrorism Preparedness and Emergency Response (COTPER); William S. Riggins, Jr., MD, MPH, Fellow, American College of Preventive Medicine; P. Lynne Stockton, VMD, MS, CDC, National Center for Health Marketing; Craig W. Thomas, PhD, Chief, Outcome Monitoring and Evaluation Branch, CDC, COTPER, Division of State and Local Readiness; and Nancy Cheal, PhD, CDC, Coordinating Center for Health Promotion, Office of the Director.

Appendix A
Epidemiologic Surveillance and Investigation
Exercise Evaluation Guide (EEG)
Version 1.0

CAPABILITY

Description: For the purpose of this article epidemiologic surveillance and investigation is the capability to establish and maintain systems to collect exposure and disease data; analyze data; detect aberrations; investigate and confirm unusual patterns; actively search for persons exposed to, potentially exposed to, or ill from biologic, chemical, or radiologic agents; alert medical and response partners; determine factors that put populations at risk; communicate with the public; report on and present investigation findings; recommend countermeasures; and study causes of epidemics and toxic exposures. Epidemiologic surveillance and investigation is an iterative process. New information learned while conducting the activities described in this capability is added to known information, and many steps are then repeated to improve the understanding of the event. In this manner the inferences made and the conclusions drawn from the information evolve over time during the investigation.

Outcome: The desired outcome is to prevent exposure to and control illness from infectious and toxic agents.

Note: The evaluation instruments are designed to be modular. Not all elements contained in this instrument apply to every situation. Subject matter experts and other emergency response planners should together determine which capabilities to strengthen in their jurisdictions. They, then, select which instruments and which elements (activities, tasks, observation keys, and performance criteria) apply to the exercise they design. The selection of modules, and how they are applied, greatly depends on the particular disease or exposure chosen and its related scenario. Exercise developers should consult current federal program guidance relevant to the disease or exposure and scenario chosen in order to assure exercise materials are created using the most up-to-date and accurate information available.

ACTIVITY 1: ONGOING SURVEILLANCE AND DETECTION

Activity Description: Monitoring disease and exposure data in the jurisdiction and raising awareness of unusual occurrences or patterns. 13

Tasks and Observation Keys

Analyze surveillance data according to existing plans and protocols.

  • A knowledgeable public health professional(s) is available to receive disease reports 24 hours per day /7 days per week /365 days per year (24/7/365)
  • Case reports from all sources validated
  • Surveillance data monitored to watch for symptoms in exposed individuals
  • Surveillance data monitored to watch for complications in persons receiving medical countermeasures
  • Surveillance data monitored to direct and evaluate public health interventions
  • Surveillance data monitored to generate hypotheses for further evaluation
  • Surveillance data monitored to identify trends in target populations
  • Surveillance data monitored to identify changes in infectious agents (e.g., antimicrobial resistance, changes in influenza virus structure)

ACTIVITY 2: CASE INVESTIGATION TO CONFIRM THE OUTBREAK

Activity Description: Determining to whom the event is occurring, what is the nature of the event, and when and where it is occurring (i.e., the who, what, when, where, and how).

Performance Measure: Public health agency personnel make a correct decision whether to conduct further epidemiologic investigation. (For quality criteria, see Appendix A2, Activity 2, Decision-Making criteria – Whether an aberration in surveillance data warrants an investigation)

Performance Measure: Health Alert Network (HAN) messages must be of minimally acceptable quality (applies also to health alerts generated by jurisdictions that have the same intent and purpose as official Health Alert Network alerts). (For quality criteria, see Appendix A2, Activity 2, Work Product Criteria – Health Alerts.)

Tasks and Observation Keys

Confirm the existence of an unusual occurrence or event

1 thought on “Exercise Evaluation Guides for Public Health Emergency Preparedness”

  1. Barbara Clements

    What an awesome tool for those of us working in emergency preparedness. Thank you.

Comments are closed.

Scroll to Top