National Academies Press: OpenBook
« Previous: 6 Evaluation of Epidemic Modeling
Suggested Citation:"7 Evaluation of Economic Modeling." National Research Council. 2012. Evaluation of the Updated Site-Specific Risk Assessment for the National Bio- and Agro-Defense Facility in Manhattan, Kansas. Washington, DC: The National Academies Press. doi: 10.17226/13418.
×

7

Evaluation of Economic Modeling

OVERVIEW OF METHODS AND ANALYSIS

The economic analysis in the updated site-specific risk assessment (uSSRA) of the proposed National Bio- and Agro-Defense Facility (NBAF) is more comprehensive than other economic analyses of foot-and-mouth disease (FMD) outbreaks (Ekboir, 1999; Paarlberg et al., 2002, 2008; Pendell et al., 2007; Hagerman et al., 2012). The uSSRA relies on three components to predict the economic consequences of an FMD epidemic: a partial equilibrium model, a regional model, and accounting of government non-indemnification costs. A partial equilibrium model of the U.S. agricultural sector describes supply and demand for U.S. livestock products, livestock, and major feed crops in global markets. A regional model captures the changes in expenditure in the 7-state region surrounding the NBAF. The models determine the impact of depopulating livestock during an outbreak, of reductions in U.S. consumer demand for livestock products, and of reduced exports of livestock products on market prices, quantities, economic welfare, and expenditure. The change in economic welfare is determined by adding the changes in returns to producer capital and management, consumer surplus, indemnification costs, changes in regional non-agricultural expenditure, and government non-indemnification costs, including surveillance, destruction, and mitigation. Compared with the 2010 SSRA, the updated analysis relies on an updated baseline with solutions for 40 quarters versus 20 quarters. Revisions in the epidemic modeling that extend the magnitude and duration of an outbreak are captured in revisions of the economic results. The uSSRA’s use of a dynamic equilibrium model and a

Suggested Citation:"7 Evaluation of Economic Modeling." National Research Council. 2012. Evaluation of the Updated Site-Specific Risk Assessment for the National Bio- and Agro-Defense Facility in Manhattan, Kansas. Washington, DC: The National Academies Press. doi: 10.17226/13418.
×

regional model are appropriate, but the committee has concerns about the analysis for reasons noted below.

INACCURATE DESCRIPTIONS OF METHODS AND ANALYSIS

Descriptions of the model and scenarios in the uSSRA are sometimes inaccurate. The partial equilibrium model is described as temporal and spatial; the latter is inaccurate. The model is temporal in that it solves dynamically to capture the lags inherent in animal and crop production. The model is not spatial inasmuch as it treats the United States as a point in space, so the uSSRA text incorrectly implies that the model handles regional differences in production and consumption and hence regional trade, which the model is not capable of handling.

The uSSRA also states that observed values are used for the 2009–2018 model baseline (p. 546), but observed values are only possible for 2009 and 2010 and not future timeframes. For 2011–2018, the model baseline is the annual U.S. Department of Agriculture (USDA) baseline from February 2011 converted into quarterly values. That means that there is more fluctuation in the 2009 and 2010 results because the USDA baseline tends to smooth out. The FMD supply shocks are introduced into the more variable baseline values. The inclusion of farm programs based on the 1996 and 2002 farm bills is mentioned on p. 545 of the uSSRA, but this version of the model incorporates the 2008 farm bill and the Average Crop Revenue Election (ACRE) program. Given the baseline crop prices, the only change in government payments to crop producers is via ACRE unless reduced feed consumption causes crop prices to fall enough to trigger traditional commodity program payments. Thus, the timeframe of 2009–2018 matters for the results because changes in U.S. government payments will not buffer losses in returns to crop growers except for the small share of production enrolled in ACRE.

In the uSSRA, there is a tendency for the text to refer to cattle, and this leaves the situation for other species vague. For example, it is unclear whether the vaccinate-to-live strategy applies to swine and sheep as well as to cattle. The uSSRA should have described the domestic demand shocks as percentage reductions in domestic demand rather than as consumers dropping meat consumption, because consumers could reduce consumption without completely avoiding red meats.

INSUFFICIENT INFORMATION PROVIDED TO VERIFY RESULTS

The quality of the estimates of economic impacts depends on input from the North American Animal Disease Spread Model, correct operation of the economic models, and decisions on scenario design. The magnitudes of livestock depopulation are estimated in the epidemic modeling. Those

Suggested Citation:"7 Evaluation of Economic Modeling." National Research Council. 2012. Evaluation of the Updated Site-Specific Risk Assessment for the National Bio- and Agro-Defense Facility in Manhattan, Kansas. Washington, DC: The National Academies Press. doi: 10.17226/13418.
×

values are converted into supply reductions and combined with demand shocks, including U.S. domestic consumer behavior and export reductions. The text and tables in the uSSRA are insufficient for the reader to replicate and evaluate the economic results.

At times, the discussion in the uSSRA does not correspond with information provided in the tables. The discussion of how supply shocks are estimated is confusing, and the information in the tables cannot be used to determine whether the supply shocks are implemented correctly. A more detailed table to illustrate the magnitudes of supply reductions for a multi-quarter outbreak would have been useful. The demand shocks as described in the text and as reported in Table 7.3.1-9 appear to be in conflict, probably because of the wording of column headings (p. 563 of the uSSRA). The text indicates that domestic demand begins to recover in the quarters immediately after the end of an outbreak, but the table shows 10% demand reductions in the p50/p50 case for the end of the outbreak + four quarters with recovery beginning in the 5th quarter after the outbreak ends.

PARTIAL EQUILIBRIUM MODEL ANALYSIS

The partial equilibrium model includes livestock products, animals, and major crops at a national level. In response to supply disruptions and reductions in domestic and export demands, the partial equilibrium model determines the quarterly time path of changes in market prices, quantities, and measures of economic welfare. Government indemnification, surveillance, mitigation, and control costs are also calculated. The uSSRA uses the partial equilibrium model, and this is a proper approach. The validity of the analysis depends on the quality and validity of the economic shocks and how the model is used. The committee finds that the upper ranges for the supply shocks, the outbreak duration, and other aspects of scenario design, which were derived from the epidemic modeling, are underestimated. The committee therefore concludes that the magnitudes of the estimated economic impacts are also underestimated.

In responding to an FMD outbreak, the vaccinate-to-live decision for outbreaks consisting of 180 days or more is important for the results. Vaccinated animals remain in the supply chain, and knowledge that vaccinated animals are in the meat supply could affect consumer response. The text is unclear about how vaccinate-to-live is reflected in the modeling: it is unclear whether those animals are excluded from the supply shocks. If so, it is unclear whether the supply shocks go to zero for quarters 3 and beyond or whether animals are still waiting destruction; the latter could affect continued supply reductions. The text does not explain that the greater assumed demand reductions for longer outbreaks partly incorporate a consumer response to having vaccinated animals in the supply chain.

The change in producer welfare is described as producer surplus, but it

Suggested Citation:"7 Evaluation of Economic Modeling." National Research Council. 2012. Evaluation of the Updated Site-Specific Risk Assessment for the National Bio- and Agro-Defense Facility in Manhattan, Kansas. Washington, DC: The National Academies Press. doi: 10.17226/13418.
×

is actually the return to capital and management. Although they are similar concepts, there are slight differences in these measures. In the partial equilibrium model, crop producers are separated from land owners, so all crop producers are modeled as tenants to isolate the changes in land rent. The change in returns to land owners should have been included in the reported uSSRA results.

REGIONAL MODEL ANALYSIS

Regional modeling determines non-agricultural changes in economic activity in the 7 states experiencing an outbreak. The regional analysis is an important component because it captures economic impacts on sectors within the 7-state region that are excluded from the partial equilibrium model. Although the regional non-agricultural costs are not large—$40 million to $6 billion in the context of the total economic impact of $16–140 billion—it is important to include such costs. These costs are concentrated in a 7-state region and concentrated on a small set of industries within that region. Because the regional model and modeling approach differ from the partial equilibrium model, care must be exercised when using these in the same analysis. The Regional Input-Output Modeling System (RIMS II) developed by the Bureau of Economic Analysis is well known and has been available for some time. Although there is extensive discussion of the regional model in general, decisions were made about multipliers (such as regional aggregation and leakages), and the multipliers used in the regional model were not included in the uSSRA but are necessary for evaluating the regional results.

Table 7.3.2-2 of the uSSRA reports expenditures for travel by state. The effect of an outbreak on travel is a major component of the regional analysis. The use of changes in expenditure as a measure of regional non-agricultural welfare effects as suggested by the table on p. 568 is a concern. A change in expenditure is not a measure of a change in economic welfare unless utility is held constant. But Table 7.4.1-1 of the uSSRA shows that changes in regional non-agricultural expenditure are added to the changes in producer returns to capital and management, consumer surplus, indemnification, and government non-indemnification costs to give the change in total economic welfare. The change in expenditure is correctly described in the text as the change in economic activity. Changes in expenditure exceed changes in economic welfare because the change in expenditure does not account for adjustment in variable costs. An alternative closer to theoretically correct measures of economic welfare—such as the return to non-traded, quasi-fixed inputs (value-added)—would have been a better choice if available.

Suggested Citation:"7 Evaluation of Economic Modeling." National Research Council. 2012. Evaluation of the Updated Site-Specific Risk Assessment for the National Bio- and Agro-Defense Facility in Manhattan, Kansas. Washington, DC: The National Academies Press. doi: 10.17226/13418.
×

NON-INDEMNIFICATION COSTS

The values for government costs used in the 2010 SSRA are adjusted for inflation and are used to determine government non-indemnification costs. There is extensive reporting of depopulation and vaccination costs in Section 6, but it is not clear why that information is not used to model economic impact in Section 7 of the uSSRA. Government costs that would have been incurred regardless should be excluded, and only additional costs incurred by government should be included; otherwise, the estimated government non-indemnification costs that are reported are higher than the actual additional costs incurred.

SUMMARY

The economic modeling approaches used in the uSSRA are frameworks that, if used properly, can address the economic impacts of an FMD outbreak that results from a breach of containment at the NBAF. The uSSRA attempts a more comprehensive analysis than existing analyses. Nevertheless, there remain concerns about the uSSRA. The information provided in the text and tables is insufficient to determine whether the analysis was done correctly. There are concerns about aggregating the results of differing modeling approaches into an aggregate economic impact. The economic consequences are generated from results obtained in the epidemic modeling. The committee believes those depopulation and duration estimates are underestimated, and consequently the supply reductions and the demand reductions used as inputs into the economic analysis are also underestimated.

REFERENCES

Ekboir, J.M. 1999. Potential Impact of Foot-and-Mouth Disease in California: The Role and Contribution of Animal Health Surveillance and Monitoring Services. Agricultural Issues Center, Division of Agriculture and Natural Resource, University of California, September 1999.

Hagerman, A.D., B.A. McCarl, T.E. Carpenter, M.P. Ward, and J. O’Brien. 2012. Emergency vaccination to control foot-and-mouth disease: Implications of its inclusion as a U.S. policy option. Appl Econ Perspect Pol 34(1):119-146.

Paarlberg, P.L., J.G. Lee, and A.H. Seitzinger. 2002. Potential revenue impacts of a foot and mouth disease outbreak in the United States. J. Am. Vet. Med. Assoc. 220(7):988-992.

Paarlberg, P.L., A. Hillberg Seitzinger, J.G. Lee, and K.H. Mathews Jr. 2008. Economic Impacts of Foreign Animal Disease. Economic Research Report ERR-57. Economic Research Service, U.S. Department of Agriculture: Washington, DC.

Pendell, D.L., T.C. Schroeder, J. Leatherman, and G.S. Alward. 2007. The economic impacts of a foot-and-mouth disease outbreak: A regional analysis. J Agr Appl Econ 39:19-33.

Suggested Citation:"7 Evaluation of Economic Modeling." National Research Council. 2012. Evaluation of the Updated Site-Specific Risk Assessment for the National Bio- and Agro-Defense Facility in Manhattan, Kansas. Washington, DC: The National Academies Press. doi: 10.17226/13418.
×

This page intentionally left blank.

Suggested Citation:"7 Evaluation of Economic Modeling." National Research Council. 2012. Evaluation of the Updated Site-Specific Risk Assessment for the National Bio- and Agro-Defense Facility in Manhattan, Kansas. Washington, DC: The National Academies Press. doi: 10.17226/13418.
×
Page 63
Suggested Citation:"7 Evaluation of Economic Modeling." National Research Council. 2012. Evaluation of the Updated Site-Specific Risk Assessment for the National Bio- and Agro-Defense Facility in Manhattan, Kansas. Washington, DC: The National Academies Press. doi: 10.17226/13418.
×
Page 64
Suggested Citation:"7 Evaluation of Economic Modeling." National Research Council. 2012. Evaluation of the Updated Site-Specific Risk Assessment for the National Bio- and Agro-Defense Facility in Manhattan, Kansas. Washington, DC: The National Academies Press. doi: 10.17226/13418.
×
Page 65
Suggested Citation:"7 Evaluation of Economic Modeling." National Research Council. 2012. Evaluation of the Updated Site-Specific Risk Assessment for the National Bio- and Agro-Defense Facility in Manhattan, Kansas. Washington, DC: The National Academies Press. doi: 10.17226/13418.
×
Page 66
Suggested Citation:"7 Evaluation of Economic Modeling." National Research Council. 2012. Evaluation of the Updated Site-Specific Risk Assessment for the National Bio- and Agro-Defense Facility in Manhattan, Kansas. Washington, DC: The National Academies Press. doi: 10.17226/13418.
×
Page 67
Suggested Citation:"7 Evaluation of Economic Modeling." National Research Council. 2012. Evaluation of the Updated Site-Specific Risk Assessment for the National Bio- and Agro-Defense Facility in Manhattan, Kansas. Washington, DC: The National Academies Press. doi: 10.17226/13418.
×
Page 68
Next: 8 Evaluation of Biosafety Level 4 Assessment »
Evaluation of the Updated Site-Specific Risk Assessment for the National Bio- and Agro-Defense Facility in Manhattan, Kansas Get This Book
×
Buy Paperback | $40.00 Buy Ebook | $32.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

Safeguarding U.S. agriculture from foreign animal diseases and protecting our food system require cutting-edge research and diagnostic capabilities. The Department of Homeland Security (DHS) and the U.S. Department of Agriculture (USDA) have embarked on an important mission to replace the aging Plum Island Animal Disease Center (PIADC) with a new facility, the National Bio- and Agro-Defense Facility (NBAF). When operational, this new facility would be the world's fourth biosafety level-4 laboratory capable of large animal research. It would serve as a critical world reference laboratory for identifying emerging and unknown disease threats, and would thus be a critical asset in securing the future health, wealth, and security of the nation.

DHS selected Manhattan, Kansas, as the site for the new NBAF after an extensive site-selection process that involved an environmental impact statement. The Government Accountability Office (GAO) raised concerns about DHS's analysis of the potential spread of foot-and-mouth disease virus (FMDv), one of the most serious foreign animal disease threats. Congress directed DHS to conduct a site-specific risk assessment (SSRA) for the NBAF, instructed the National Research Council (NRC) to independently evaluate the SSRA, and prohibited obligation of NBAF construction funds until the NRC review was complete.

Congress mandated that DHS revise its SSRA to address shortcomings of the 2010 SSRA, directed the NRC to evaluate the updated SSRA (uSSRA), and again prohibited obligation of construction funds until the completion of the second review. The scope for both of these SSRA reports addressed accidental release of pathogens from the NBAF in Manhattan, Kansas and excluded terrorist acts and malicious threats from its risk assessments. Evaluation of the Updated Site-Specific Risk Assessment for the National Bio- and Agro-Defense Facility in Manhattan, Kansas is the evaluation of the final uSSRA.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!