Quality Assurance in Design-Build Projects (2008)

Below is the uncorrected machine-read text of this chapter, intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text of each book. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.

100 APPENDIX C General Survey Questionnaire and Reponses This appendix presents the questionnaire and a summary of the detailed responses. NCHRP Synthesis 38-01: Quality A ssurance in Design-Build Projects INTRODUCTION/BACKGROUND: Transportation Research Circular E-C090 expresses the motivation for this synthesis as follows: “Design-build (DB) is gaining momentum in its use by transportation agencies. Comfortable with the quality management process used in design-bid-build, many agencies are seek ing assurance that the quality level of the completed project with design-build is n ot compromised.” Thus, the intent of this sy nthesis is to capture the various way s in which quality assurance is handled in DB projects. The sy n thesis will identify different approaches and models, and best practices recognizing the differences in each of the different delivery meth ods. The sy nthesis will also address how the core principles of quality assurance can be satisfactorily addressed in design-build projec ts. The purpose of this questionnaire is to identify how state highway agencies (SHAs) that have implemented DB have implemented wi th quality assurance (QA) programs in their DB projects and from th at baseline, identify DB QA best practices for dissemination an d use by SHAs that intend to implement DB procurement on future projects. DEFINITIONS: The synthesis will use TRB Circular E-C074 , Glossary of Highway Quality Assurance Terms to standardize its terminology . The following are terms that must be car efully understood to properly complete this survey. Quality assurance (QA). All those planned and systematic actions necessary to provide confidence that a product or facility wil l perform satisfactorily in service [QA addresses the overall problem of obtaining the quality of a service, product, or facility in the most efficient, economical, and satisfactory manner possible. Within this broad context, QA involves continued evaluation of the activities of planning, design, development of plans and specifications, advertising and awarding of contracts, construction, and maintenance, and the interactions of these activities.] ( TRB E-C074 ) Design-build (DB): A project delivery method where both the design and the construction of the project are simultaneously award ed to a single entity . Design-bid-build (DBB): A project delivery method where the design is completed either by in-house professional engineering sta ff or a design consultant before the construction contract is advertised; also called the “traditional method.” Design deliverable: A product produced by the design-builder’s design team that is submitted for review to the agency (i.e., de sign packages, construction documents, etc.). Construction deliverable: A product produced by the design-builder’s construction team that is s ubmitted for review to the agen cy (shop drawings, product submittals, etc.). Please e-mail, fax, or post this questi onnaire by one of the following means: Dr. Doug Gransberg, PE University of Oklahoma Construction Science 830 Van Vleet Oval, Room 162 Norman, OK 73026 Voice: 405-325-6092 Fax: 405-325-7558 E-mail: dgransberg@ou.edu

101 General Information: 1. U.S. state in which the respondent is employ ed: DOTs That Have Done DB Other Public Agency Private Industry DOTs That Have Not Done DB AL, AK, AZ, CO, FL, GA, HI, IN, KY, LA, ME, MD, MI, MN, MO, MS, MT, NV, NH, NM, NY, NC, OH, OR, SC, TX, UT, VA, WA, WV, WI CA, CO, MA, NJ, OR, UT CA, CO, OK, TX AR, CT, IA, ID, IL, KS, NE, ND, OK, TN, VT, WY 2. What ty pe of organization do y ou work for? [If you check “consulting engineering firm,” “construction contractor,” “integra ted DB firm,” or “other,” move to Question 11.] State department of transportation 52 Other public transportation agency 6 Consulting engineering firm (primarily a designer) 0 Construction contractor (primarily a builder) 1 Integrated DB firm (internal ability to do both design and construction) 2 Other 2 Total 63 3. If y ou answered state DOT or Other Public Agency above, what group/section do y ou primarily work in? DOT Other Public Agency Total Design group/section 6 0 6 Construction group/section 19 6 25 Operations group/section 0 0 0 Maintenance group/section 1 0 1 Design-build group/section 7 1 8 Materials group/section 0 0 0 Other 4 0 4 Total 37 7 44 4. Has y our agency awarded a design-build project? [If your agency has not yet awarded a DB project, but either is in the proce ss or plans to in the future, please continue the questionnaire.] DOT Other Public Agency Total Yes 34 6 40 Not ye t, but will in the future 6 0 6 No 20 0 20 Total 60 6 66 5. In what y ear did or will y our agency award its first DB project? DOT Other Public Agency 1988, 1996 (3), 1997 (4), 1998 (5), 1999, 2000 (2), 2001 (5), 2002 (3), 2003 (2), 2004 (1), 2005 (2), 2006 (2), 2007 (2), legislation pending, not sure 1992, 1998 (1), 2000 (1), 2001 (2), 2004

102 6. How many DB projects has your agency awarded since then? DOT Other Public Agency Total 1–5 projects 19 6 25 5–10 projects 4 0 4 Greater than 10 9 0 9 Not applicable 7 0 7 Total 39 6 45 7. About what percentage of your agency’s total number of projects do DB projects make up? DOT Other Public Agency Total Less than 1% 24 0 24 2% to 5% 10 0 10 6% to 10% 0 1 1 11% to 25% 1 5 6 26% to 50% 0 0 0 Greater than 50% 0 0 0 Not applicable 5 0 5 Total 40 6 46 8. About what percentage of your agency’s total construction budget do DB projects make up? DOT Other Public Agency Total Less than 1% 8 0 8 2% to 5% 11 0 11 6% to 10% 6 1 7 11% to 25% 8 3 11 26% to 50% 1 1 2 Greater than 50% 0 1 1 Not applicable 5 0 5 Total 39 6 45 9. Has your agency reduced the number of professional engineers it employs as a direct result of implementing DB contracting? DOT Other Public Agency Total Yes 1 0 1 No 38 6 44 If Yes, by what average percentage, 5%? 10. Did your agency implement DB contracting as a means to augment its existing workforce? DOT Other Public Agency Total Yes 11 1 12 No 26 4 30 Not applicable/don’t know 3 1 4 Total 40 6 46

103 11. What are the primary reasons for your organization’s decision to use DB contracting? (Check all that apply.) DOT Other Public Agency Total Augment existing workforce 9 1 10 Reduce schedule 28 6 34 Reduce costs 8 1 9 Establish costs earlier 8 5 13 Encourage innovation 22 5 27 Share or transfer risk 16 5 21 Other 11 0 11 Total 102 23 125 Public agency respondents should now go to the next section: “Design-Build Policy Information” located after Question 16. Private industry respondents continue here at Question 12. 12. How many DB transportation projects has your organization (i.e., consulting engineering, construction, or integrated DB firm) been involved in? Private Industry 1–5 projects 0 5–10 projects 1 Greater than 10 3 Not applicable 0 Total 4 13. About what percentage of your organization’s total number of projects do DB transportation projects make up? Private Industry Less than 1% 0 2% to 5% 0 6% to 10% 2 11% to 25% 1 26% to 50% 0 Greater than 50% 1 Not applicable 0 Total 4 14. About what percentage of your organization’s total volume ($ value) do DB transportation projects make up? Private Industry Less than 1% 0 2% to 5% 1 6% to 10% 0 11% to 25% 1 26% to 50% 1 Greater than 50% 1 Not applicable 0 Total 4 15. In which states has your organization participated in a DB transportation project? Please list: CA, CO, FL, ID, MN, NY, NC, NV, OR, SC, SD, TX, UT, VA, WA, and others.

104 Design-Build Policy Information : The following questions will break up the design-build quality management process into the following three phases: • Procurement Phase: Actions taken regard ing the quality management process that are reflected in the D B solicitation documentation such as in the Request for Qualifications (RFQ) and the Request for Proposals (RFP). • Design Phase: Actions taken after contract award regarding ensuring the quality of the design deliverables as well as that the final design complies with contractual requirements. • Construction Phase: Actions taken after contract award regarding the quality of the final constructed product to ensure that it complies with both the completed design and other contractual requirements. The research team understands tha t term “Approval” has a variety of slightly different meanings from state to state. It is used here to indicate the process by which t he agency indicates that it is satisfied with the design-builder’s design or construction deliverable and is willing to make pay ment for satisfactory completion of that task if asked. Procurement Phas e : Agency respondents: please answer for your agency. Industry respondents: If you have observed differences between agencies, please answer the question with what y ou believe to be the most prevalent practice. 16. Does either the RFQ or the RFP require the following to be submitted as part of the design-build proposal? State DOTs If Yes, it is required: Is it evaluated to make the DB award decision? Yes If Yes, it is required: Is it evaluated to make the DB award decision? Yes If Yes, it is required: Is it evaluated to make the DB award decision? No If Yes, it is required: Is it evaluated to make the DB award decision? No If No, it’s not required: Is it required to be submitted after contract award? Yes If No, it’s not required: Is it required to be submitted after contract award? No Qualifications of the DB Quality Manager 23 0 3 5 Qualifications of the Design Quality Manager 24 0 3 4 Qualifications of the Construction Quality Manager 22 1 4 4 Design quality management plan 17 1 10 3 Design quality assurance plan 14 2 11 4 Design quality control plan 13 2 12 3 Construction quality management plan 16 0 4 1 Construction quality assurance plan 13 0 13 5 Construction quality control plan 11 0 15 4 16. Does either the RFQ or the RFP require the following to be submitted as part of the design-build proposal? Other Public Agencies If No, it’s not required: Is it required to be submitted after contract award? Yes If No, it’s not required: Is it required to be submitted after contract award? No Qualifications of the DB Quality Manager 6 0 0 0 Qualifications of the Design Quality Manager 5 0 0 1 Qualifications of the Construction Quality Manager 5 0 0 1 Design quality management plan 2 1 1 2 Design quality assurance plan 2 0 1 3 Design quality control plan 2 0 1 3 Construction quality management plan 3 1 1 1 Construction quality assurance plan 3 1 1 1 Construction quality control plan 3 1 1 1

105 If Yes, it is required: Is it evaluated to make the DB award decision? Yes If Yes, it is required: Is it evaluated to make the DB award decision? No If No, it’s not required: Is it required to be submitted after contract award? Yes If No, it’s not required: Is it required to be submitted after contract award? No If Yes, it is required: Is it evaluated to make the DB award decision? Yes If Yes, it is required: Is it evaluated to make the DB award decision? No If No, it’s not required: Is it required to be submitted after contract award? Yes If No, it’s not required: Is it required to be submitted after contract award? No If Yes, it is required: Is it evaluated to make the DB award decision? Yes If Yes, it is required: Is it evaluated to make the DB award decision? No If No, it’s not required: Is it required to be submitted after contract award? Yes If No, it’s not required: Is it required to be submitted after contract award? No If Yes, it is required: Is it evaluated to make the DB award decision? Yes If Yes, it is required: Is it evaluated to make the DB award decision? No If No, it’s not required: Is it required to be submitted after contract award? Yes If No, it’s not required: Is it required to be submitted after contract award? No Qualifications of the DB Quality Manager 2 1 1 0 Qualifications of the Design Quality Manager 2 1 1 0 Qualifications of the Construction Quality Manager 3 0 1 0 Design quality management plan 1 1 2 0 Design quality assurance plan 0 1 3 0 Design quality control plan 0 1 3 0 Construction quality management plan 1 1 2 0 Construction quality assurance plan 0 1 3 0 Construction quality control plan 0 1 3 0 17. Does either your RFQ or your RFP contain the following? State DOTs Design criteria checklists 11 5 7 7 Construction testing matrix 9 3 10 9 Quality management roles and responsibilities 22 3 2 4 17. Does either your RFQ or your RFP contain the following? Other Public Agencies Design criteria checklists 4 0 0 2 Construction testing matrix 1 1 1 3 Quality management roles and responsibilities 3 1 0 2 17. Does either your RFQ or your RFP contain the following? Private Industry Private Industry Design criteria checklists 0 0 3 1 Construction testing matrix 0 0 4 0 Quality management roles and responsibilities 2 0 2 0 16. Does either the RFQ or the RFP require the following to be submitted as part of the design-build proposal?

106 Design Phase 18. Who primarily performs the following design quality management tasks? [If the task is shared between two or more of the following entities, check the one that has primary responsibility.] [Note: Because some respondents indicated more than one response for this question, the authors decided to use a point system to calculate percentages used in the paper. Four points were possible for each answer. If only one answer was marked, four points were assigned. If all four possibilities were marked, one point was given to each category. This matrix only tabulates each time a response was marked and does not use the point system. Thus, percentages in this table will not match percentages in the paper.] Who primarily performs the following design quality management tasks? [If the task is shared between two or more of the following entities, check the one that has primary responsibility.] [Note: Because some respondents indicated more than one response for this question, the authors decided to use a point system to calculate percentages used in the paper. Four points were possible for each answer. If only one answer was marked, four points were assigned. If all four possibilities were marked, one point was given to each category. This matrix only tabulates each time a response was marked and does not use the point system. Thus, percentages in this table will not match percentages in the paper.] State DOTs Agency Personnel Design-Builder’s Design Staff Design-Builder’s Construction Staff Agency-Hired Consultant Does Not Apply Technical review of design deliverables 16 17 1 12 0 Checking of design calculations 8 23 1 8 0 Checking of quantities 7 17 8 6 5 Acceptance of design deliverables 11 8 2 9 0 Review of specifications 19 13 4 11 0 Approval of final construction plans and other design documents 29 4 2 3 0 Approval of progress payments for design progress 29 2 0 5 0 Approval of post-award design QM/QA/QC plans 28 3 0 7 1 18. Other Public Agencies Agency Personnel Design-Builder’s Design Staff Design-Builder’s Construction Staff Agency-Hired Consultant Does Not Apply Technical review of design deliverables 2 2 0 5 0 Checking of design calculations 0 5 0 1 0 Checking of quantities 1 4 1 0 0 Acceptance of design deliverables 5 1 0 0 0 Review of specifications 0 2 0 4 0 Approval of final construction plans and other design documents 6 0 0 0 0 Approval of progress payments for design progress 6 0 0 0 0 Approval of post-award design QM/QA/QC plans 6 0 0 0 0

107 Private Industry Agency Personnel Design-Builder’s Design Staff Design-Builder’s Construction Staff Agency-Hired Consultant Does Not Apply Technical review of design deliverables 1 3 0 1 0 Checking of design calculations 1 3 0 0 0 Checking of quantities 0 2 2 0 1 Acceptance of design deliverables 2 2 0 0 0 Review of specifications 0 4 0 0 0 Approval of final construction plans and other design documents 2 1 0 1 0 Approval of progress payments for design progress 2 0 2 1 0 Approval of post-award design QM/QA/QC plans 3 0 0 1 0 Construction Phase 19. Who primarily performs the following construction quality management tasks? [If the task is shared between two or more of the following entities, check the one that has primary responsibility.] [Note: Because some respondents indicated more than one response for this question, the authors decided to use a point system to calculate percentages used in the paper. Four points were possible for each answer. If only one answer was marked, four points were assigned. If all four possibilities were marked, one point was given to each category. This matrix only tabulates each time a response was marked and does not use the point system. Thus, percentages in this table will not match percentages in the paper.] State DOTs Agency Personnel Design-Builder’s Design Staff Design-Builder’s Construction Staff Agency-Hired Consultant Does Not Apply Technical review of construction shop drawings 6 24 9 12 0 Technical review of construction material submittals 18 12 10 10 0 Checking of pay quantities 19 5 7 11 2 Routine construction inspection 11 7 21 7 0 Quality control testing 6 9 23 7 0 Establishment of horizontal and vertical control on site 4 10 24 1 0 Verification/acceptance testing 21 1 5 14 0 Approval of progress payments for construction progress 30 2 0 7 0 Approval of construction post- award QM/QA/QC plans 29 2 1 9 3 Report of nonconforming work or punch list 27 6 9 9 0 Who primarily performs the following design quality management tasks? [If the task is shared between two or more of the following entities, check the one that has primary responsibility.] [Note: Because some respondents indicated more than one response for this question, the authors decided to use a point system to calculate percentages used in the paper. Four points were possible for each answer. If only one answer was marked, four points were assigned. If all four possibilities were marked, one point was given to each category. This matrix only tabulates each time a response was marked and does not use the point system. Thus, percentages in this table will not match percentages in the paper.] 18.

108 Technical review of construction material submittals 0 2 0 3 0 Checking of pay quantities 2 0 0 3 1 Routine construction inspection 0 0 5 1 0 Quality control testing 0 0 6 0 0 Establishment of horizontal and vertical control on site 0 0 6 0 0 Verification/acceptance testing 1 0 0 5 0 Approval of progress payments for construction progress 6 0 0 0 0 Approval of construction post- award QM/QA/QC plans 6 0 0 0 0 Report of nonconforming work or punch list 3 0 1 2 0 19. Who primarily performs the following construction quality management tasks? [If the task is shared between two or more of the following entities, check the one that has primary responsibility] [Note: Because some respondents indicated more than one response for this question, the authors decided to use a point system to calculate percentages used in the paper. Four points were possible for each answer. If only one answer was marked, four points were assigned. If all four possibilities were marked, one point was given to each category. This matrix only tabulates each time a response was marked and does not use the point system. Thus, percentages in this table will not match percentages in the paper.] Private Industry Agency Personnel Design-Builder’s Design Staff Design-Builder’s Construction Staff Agency-Hired Consultant Does Not Apply Technical review of construction shop drawings 0 4 0 0 0 Technical review of construction material submittals 1 2 1 0 0 Checking of pay quantities 2 0 1 0 1 Routine construction inspection 0 0 3 1 0 Quality control testing 0 0 3 1 0 Establishment of horizontal and vertical control on site 0 1 3 0 0 Verification/acceptance testing 1 0 1 2 0 Approval of progress payments for construction progress 3 0 1 0 0 Approval of construction post- award QM/QA/QC plans 3 1 0 1 0 Report of nonconforming work or punch list 1 0 1 2 0 19. Who primarily performs the following construction quality management tasks? [If the task is shared between two or more of the following entities, check the one that has primary responsibility] [Note: Because some respondents indicated more than one response for this question, the authors decided to use a point system to calculate percentages used in the paper. Four points were possible for each answer. If only one answer was marked, four points were assigned. If all four possibilities were marked, one point was given to each category. This matrix only tabulates each time a response was marked and does not use the point system. Thus, percentages in this table will not match percentages in the paper.] Other Public Agencies Agency Personnel Design-Builder’s Design Staff Design-Builder’s Construction Staff Agency-Hired Consultant Does Not Apply Technical review of construction shop drawings 0 4 0 2 0

109 21. Is the DB CONSTRUCTION QA/QC plan significantly different from the QA/QC plan used on traditional design projects? If yes, what is the major difference? [Various answers were received.] 22. Is the DB design and construction QA/QC plan significantly different from the QA/QC plan used on traditional DB projects when the project is a public-private partnership or when an extended Maintenance Agreement is included? If yes, what is the major difference? [Various answers were received.] 23. Does the agency specify what must be included in the design-builder’s QA/QC plans? 24. Does the agency mandate the use of its own standard QA/QC plans? State DOTs Other Public Agencies Private Industry Total Yes 17 2 3 22 No 14 4 1 19 Total 31 6 4 41 State DOTs Other Public Agencies Private Industry Total Yes 2 3 3 8 No 12 2 1 15 Total 14 5 4 23 State DOTs Other Public Agencies Private Industry Total Yes, on all projects 26 5 3 34 Only on selected projects 0 0 1 1 No, never 3 1 0 4 Total 29 6 4 39 State DOTs Other Public Agencies Private Industry Total Yes, on all projects 8 2 0 10 Only on selected projects 6 0 3 9 No, never 15 4 1 20 Total 29 6 4 39 Quality Management Planning: Please answer the following questions from a general perspective based on your experience. If you are an industry practitioner and have observed differences between agencies, please answer the question with what you believe to be the most prevalent practice. 20. Is the DB DESIGN QA/QC plan significantly different from the QA/QC plan used on traditional DBB construction projects? If “yes,” what is the major difference? [Various answers were received.] State DOTs Other Public Agencies Private Industry Total Yes 12 2 3 17 No 19 4 1 24 Total 31 6 4 41

110 26. Does the agency mandate the use of standard agency design/construction details? 27. Does the agency mandate the use of standard agency construction means and/or methods? 28. Does the agency mandate a specific set of qualifications for the design-builder’s quality management staff? If yes or only, what are those qualifications? [Various answers were received.] 29. Does the agency mandate a specific set of qualifications for the design-builder’s design quality assurance staff? If yes or only, what are those qualifications? [Various answers were received.] State DOTs Other Public Agencies Private Industry Total Yes, on all projects 22 1 2 25 Only on selected projects 6 0 1 7 No, never 1 5 1 7 Total 29 6 4 39 State DOTs Other Public Agencies Private Industry Total Yes, on all projects 9 0 0 9 Only on selected projects 6 0 1 7 No, never 14 5 3 22 Total 29 5 4 38 State DOTs Other Public Agencies Private Industry Total Yes, on all projects 22 2 3 27 Only on selected projects 1 0 1 2 No, never 7 3 0 10 Total 30 5 4 39 State DOTs Other Public Agencies Private Industry Total Yes, on all projects 22 2 2 26 Only on selected projects 1 0 2 3 No, never 7 4 0 11 Total 30 6 4 40 25. Does the agency mandate the use of standard agency design/construction specifications? State DOTs Other Public Agencies Private Industry Total Yes, on all projects 26 2 1 29 Only on selected projects 2 0 3 5 No, never 0 3 0 3 Total 28 5 4 37

111 General: 31. Do y ou think that the agency holds the design-builder’s de sign staff to a higher standard of care than it sets for its int ernal design staff? Comments: There can be no doubt about this at all! DB design staff holds themselves to a higher standard of care. We held the DB team to the same standards that we would any consultant engineering firm or an internal designer developing a project. High standard of documented care. 32. Do y ou think that the agency holds the design-builder’s c onstruction quality management staff to a higher standard of care than it sets for its internal construction inspection staff? Comments: QC/QA team holds itself to a higher standard of care. [No], However, it seems DBs are struggling getting Construction QA and QC staff that meet our expectations. The DB Team was held to the same standards of a normal c ontractor, even with the warrant y provisions in the contract. High standard of documented care. 33. Does y our organization have a document that outlines its approach to design-build quality assurance? If yes and you would be willing to share it with this research project, please contact Dr. Doug Gransberg. State DOTs Other Public Agencies Private Industry Total Yes 4 0 1 5 No 21 1 2 24 No opinion 5 5 0 10 Total 30 6 3 39 State DOTs Other Public Agencies Private Industry Total Yes 6 0 1 7 No 20 1 2 23 No opinion 3 5 0 8 Total 29 6 3 38 State DOTs Other Public Agencies Private Industry Total Yes 16 1 3 20 No 14 5 1 20 Total 30 6 4 40 30. Does the agency mandate a specific set of qualifications for the design-builder’s construction quality control staff? If ye s or only , what are those qualifications? [Various answers were received.] State DOTs Other Public Agencies Private Industry Total Yes, on all projects 22 2 3 27 Only on selected projects 1 0 0 1 No, never 4 4 1 9 Total 27 6 4 37

112 35. What are the three biggest challenges to implementing QA on DB projects? [Various answers were received.] 36. Please rate the following factors for their impact on the quality of the DB project. State DOTs Very High Impact High Impact Some Impact Slight Impact No Impact N/A Qualifications of the design- builder’s staff 12 14 3 0 0 0 Design-builder’s past project experience 7 12 7 3 0 0 Quality management plans 4 12 11 1 0 0 Level of agency involvement in the QA process 5 18 6 0 0 0 Use of agency specifications and/or design details 8 12 5 3 1 0 Level of detail expressed in the procurement documents (RFQ/RFP) 6 11 10 1 0 0 Use of performance criteria/specifications 6 12 8 1 0 1 Detailed design criteria 4 17 6 1 0 0 Warranty provisions 5 7 7 5 0 4 Follow-on maintenance agreement 6 4 1 3 2 12 Design-builder financing (PPP/concession) 5 4 1 1 1 16 36. Please rate the following factors for their impact on the quality of the DB project. Other Public Agencies Very High Impact High Impact Some Impact Slight Impact No Impact N/A Qualifications of the design- builder’s staff 3 3 0 0 0 0 Design-builder’s past project experience 3 3 0 0 0 0 Quality management plans 1 3 2 0 0 0 Level of agency involvement in the QA process 1 2 3 0 0 0 Use of agency specifications and/or design details 0 0 5 1 0 0 Level of detail expressed in the procurement documents (RFQ/RFP) 3 1 2 0 0 0 Use of performance criteria/specifications 0 5 1 0 0 0 Detailed design criteria 1 2 3 0 0 0 34. Which of the below best describes your agency’s approach to DB QA? State DOTs Other Public Agencies Private Industry Total Design-builder primarily responsible for QA—the Agency audits design-builder’s program 9 1 4 14 Agency retains traditional QA roles 6 1 0 7 Agency retains an independent party to perform QA roles 2 0 0 2 Agency uses two or more of the above depending on the project 14 4 0 18 None of the above 0 0 0 0 Total 31 6 4 41

113 Level of agency involvement in the QA proces s 0 2 1 1 0 0 Use of agency specifications and/or design details 0 2 2 0 0 0 Level of detail expressed in the procurement documents (RFQ/RFP) 2 2 0 0 0 0 Use of performance criteria/specifications 1 2 1 0 0 0 Detailed design criteria 2 0 2 0 0 0 Warranty provisions 1 0 1 1 1 0 Follow-on maintenance agreement 1 0 1 1 0 1 Design-builder financing (PPP/concession) 2 0 1 0 1 0 37. Do you have any other information that you would be willing to share with the authors that might add value to this research? If so, please submit it in the following text block. [Various answers were received.] 38. If you are willing, please indicate the name of a point of contact that we may contact with possible questions on your answers to this survey. [Various answers were received.] 39. E-mail address for survey point of contact. [Various answers were received.] 40. Phone number for survey point of contact. [Various answers were received.] Warranty provisions 1 5 0 0 0 0 Follow-on maintenance agreement 1 1 0 0 0 4 Design-builder financing (PPP/concession) 0 0 1 0 0 5 36. Please rate the following factors for their impact on the quality of the DB project. Private Industry Very High Impact High Impact Some Impact Slight Impact No Impact N/A Qualifications of the design-builder’s staff 3 0 1 0 0 0 Design-builder’s past project experience 2 1 1 0 0 0 Quality management plans 1 2 0 1 0 0