National Academies Press: OpenBook

An Assessment of the SBIR Program at the Department of Energy (2008)

Chapter: Appendix B: NRC Phase II Survey

« Previous: Appendix A: DoE SBIR Program Data
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 135
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 136
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 137
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 138
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 139
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 140
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 141
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 142
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 143
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 144
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 145
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 146
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 147
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 148
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 149
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 150
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 151
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 152
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 153
Suggested Citation:"Appendix B: NRC Phase II Survey." National Research Council. 2008. An Assessment of the SBIR Program at the Department of Energy. Washington, DC: The National Academies Press. doi: 10.17226/12052.
×
Page 154

Below is the uncorrected machine-read text of this chapter, intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text of each book. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.

Appendix B NRC Phase II Survey The first section of this appendix describes the methodology used to survey Phase II SBIR awards (also referred to as projects). The second part presents the results—of the awards, or project, survey (NRC Phase II Survey). (Appendix C presents the NRC Phase I survey.) About the Surveys Starting Date and Coverage The survey of SBIR Phase II awards was administered in 2005 and included awards made through 2001. This allowed most of the Phase II awarded projects (nominally two years) to be completed and provided some time for commercial- ization. The selection of the end date of 2001 was consistent with a GAO study, which in 1991 surveyed awards made through 1987. A start date of 1992 was selected. The year 1992 for the earliest Phase II project was considered a realistic starting date for the coverage, allowing inclu- sion of the same (1992) projects as the Department of Defense (DoD) 1996 sur- vey, and of the 1992 and 1993 projects surveyed in 1998 for the Small Business Administration (SBA). This adds to the longitudinal capacities of the study. The 10 years of Phase II coverage spanned the period of increased funding set-asides and the impact of the 1992 reauthorization. This time frame allowed for extended periods of commercialization and for a robust spectrum of economic conditions. Establishing 1992 as the cut-off date for starting the survey helped to avoid the problems from which older awards suffer, including meager early data collection 135

136 APPENDIX B as well as potentially irredeemable data loss; the fact that some firms and princi- pal investigators (PIs) are no longer in place; and fading memories. Award Numbers While adding the annual awards numbers of the five agencies would seem to define the larger sample, the process was more complicated. Agency reports usually involve some estimating and anticipation of successful negotiation of selected proposals. Agencies rarely correct reports after the fact. Setting limita- tions on the number of projects to be surveyed from each firm required knowing how many awards each firm had received from all five agencies. Thus, the first step was to obtain all of the award databases from each agency and combine them into a single database. Defining the database was further complicated by variations in firm identification, location, phone numbers, and points of contact within individual agency databases. Ultimately, we determined that 4,085 firms had been awarded 11,214 Phase II awards (an average of 2.7 Phase II awards per firm) by the five agencies during the 1992-2001 time frame. Using the most recent awards, the firm information was updated to the most current contact information for each firm. Sampling Approaches and Issues The Phase II Survey used an array of sampling techniques to ensure adequate coverage of projects, to address a wide range both of outcomes and potential explanatory variables, and also to address the problem of skew. That is, a rela- tively small percentage of funded projects typically account for a large percentage of commercial impact in the field of advanced, high-risk technologies. • Random Samples. After integrating the 11,214 awards into a single data- base, a random sample of approximately 20 percent was sampled. Then a random sample of 20 percent was ensured for each year; e.g., 20 percent of the 1992 awards, of the 1993 awards, etc. Verifying the total sample one year at a time allowed improved ability to adapt to changes in the program over time, as otherwise the increased number of awards made in recent years might dominate the sample. • Random Sample by Agency. Surveyed awards were grouped by agency; additional respondents were randomly selected as required to ensure that at least 20 percent of each agency’s awards were included in the sample. • Firm Surveys. After the random selection, 100 percent of the Phase IIs that went to firms with only one or two awards were polled. These are the hardest firms to find for older awards. Address information is highly

APPENDIX B 137 perishable, particularly for earlier award years. For firms that had more than two awards, 20 percent were selected, but no less than two. • Top Performers. The problem of skew was dealt with by ensuring that all Phase IIs known to meet a specific commercialization threshold (total of $10 million in the sum of sales plus additional investment) were surveyed (derived from the DoD commercialization database). Since 56 percent of all awards were in the random and firm samples described above, only 95 Phase IIs were added in this fashion. • Coding. The project database tracks the survey sample, which corre- sponds with each response. For example, it is possible for a randomly sampled project from a firm that had only two awards to be a top per- former. Thus, the response could be analyzed as a random sample for the program, a random sample for the awarding agency, a top performer, and as part of the sample of single or double winners. In addition, the database allows examination of the responses for the array of potential explanatory or demographic variables. • Total Number of Surveys. The approach described above generated a sample of 6,410 projects and 4,085 firm surveys—an average of 1.6 award surveys per firm. Each firm receiving at least one project survey also received a firm survey. Although this approach sampled more than 57 percent of the awards, multiple award winners, on average, were asked to respond to surveys covering about 20 percent of their projects. Administration of the Survey The questionnaire drew extensively from the one used in the 1999 National Research Council assessment of SBIR at the Department of Defense, The Small Business Innovation Research Program: An Assessment of the Department of Defense Fast Track Initiative. That questionnaire in turn built upon the ques- tionnaire for the 1991 GAO SBIR study. Twenty-four of the 29 questions on the earlier NRC study were incorporated. The researchers added 24 new questions to attempt to understand both commercial and noncommercial aspects, including knowledge base impacts, of SBIR, and to gain insight into impacts of program management. Potential questions were discussed with each agency, and their For NRC Firm Survey results, see National Research Council, An Assessment of The Small Business Innovation Research Program, Charles W. Wessner, ed., Washington, DC: The National Academies Press, 2008. National Research Council, The Small Business Innovation Research Program: An Assessment of the Department of Defense Fast Track Initiative, Charles W. Wessner, ed., Washington, DC: National Academy Press, 2000.

138 APPENDIX B input was considered. In determining questions that should be in the survey, the research team also considered which issues and questions were best examined in the case studies and other research methodologies. Many of the resultant 32 Phase II Survey questions and 15 Firm Survey questions had multiple parts. The surveys were administered online, using a Web server. The formatting, encoding and administration of the survey was subcontracted to BRTRC, Inc., of Fairfax, Virginia. There are many advantages to online surveys (including cost, speed, and possibly response rates). Response rates become clear fairly quickly, and can rapidly indicate needed follow up for nonrespondents. Hyperlinks provide ampli- fying information, and built-in quality checks control the internal consistency of the responses. Finally, online surveys allow dynamic branching of question sets, with some respondents answering selected subsets of questions but not others, depending on prior responses. Prior to the survey, we recognized two significant advantages of a paper sur- vey over an online one. For every firm (and thus every award), the agencies had provided a mailing address. Thus surveys could be addressed to the firm president or CEO at that address. That senior official could then forward the survey to the correct official within the firm for completion. For an online survey we needed to know the email address of the correct official. Also each firm needed a password to protect its answers. We had an SBIR point of contact (POC) and an email address and a password for every firm, which had submitted for a DoD SBIR 1999 survey. However, we had only limited email addresses and no passwords for the remainder of the firms. For many, the email addresses that we did have were those of principal investigators rather than an official of the firm. The deci- sion to use an online survey meant that the first step of survey distribution was an outreach effort to establish contact with the firms. Outreach by Mail This outreach phase began with establishing a National Academy of Sciences (NAS) registration Web site which allowed each firm to establish a POC, an email address, and a password. Next, the Study Director, Dr. Charles Wessner, sent a letter to those firms for which email contacts were not available. Ultimately, only 150 of the 2,080 firms provided POC/email after receipt of this letter. The U.S. Postal Service returned 650 of those letters as invalid addresses. Each returned letter required thorough research by calling the agency-provided phone number for the firm, then using the Central Contractor Registration database, Business.com (powered by Google), and Switchboard.com to try to find correct address information. When an apparent match was found, the firm was called to verify that it was, in fact, the firm, which had completed the SBIR. Two hundred The letter was also erroneously sent to an additional 43 firms that had received only STTR awards.

APPENDIX B 139 thirty-seven of the 650 missing firms were so located. Another 10 firms that had gone out of business and had no POC were located. Two months after the first mailing, a second letter from the study direc- tor was mailed to firms whose first letter had not been returned, but which had not yet registered a POC. This letter also went to 176 firms, which had a POC email but no password, and to the 237 newly corrected addresses. The large number of ­letters (277) from this second mailing that were returned by the U.S. Postal ­Service indicated that there were more bad addresses in the first mailing than were indicated by its returned mail. (If the initial letter was inadvertently delivered, it may have been thrown away.) Of the 277 returned second letters, 58 firms were located using the search methodology described above. These firms were asked on the phone to go to the registration Web site to enter POC/email/­ password. A total of 93 firms provided POC/email/password on the registration site subsequent to the second mailing. Three additional firms were identified as out of business. The final mailing, a week before survey, was sent to those firms that had not received either of the first two letters. It announced the study/survey and requested support of the 1,888 CEOs for which we had assumed good POC/email information from the DoD SBIR submission site. That letter asked the recipients to provide new contact information at the DoD submission site if the firm infor- mation had changed since their last submission. One hundred seventy-three of these letters were returned. We were able to find new addresses for 53 of these, and to ask those firms to update their information. One hundred fifteen firms could not be found, and 5 more were identified as out of business. The three mailings had demonstrated that at least 1,100 (27 percent) of the mailing addresses were in error, 734 of which firms could not be found, and 18 were reported to be out of business. Outreach by Email We began Internet contact by emailing the 1,888 DoD POCs to verify their email addresses and to give them an opportunity to identify a new POC. Four hundred ninety-four of those emails bounced. The next email went to 788 email addresses that we had received from agencies as PI email addresses. We asked that the PI have the correct company POCs identify themselves at the NAS Update registration site. One hundred eighty-eight of these emails bounced. After a more detailed search of the list used by the National Institutes of Health (NIH) to send out their survey, we identified 83 additional PIs and sent them the PI email discussed above. Email to the POCs not on the DoD Submission site resulted in 110 more POCs/emails/passwords being registered on the NAS registration site. We began the survey at the end of February with an email to 100 POCs as a beta test and followed that with another email to 2,041 POCs (total of 2,141) a week later.

140 APPENDIX B Survey Responses By August 5, 2005, five months after release of the survey, 1,239 firms had begun and 1,149 firms had completed at least 14 of 15 questions on the Firm Survey. Project surveys were begun on 1,916 Phase II awards. Of the 4,085 firms that received Phase II SBIR awards from DoD, NIH, NASA, NSF, or DoE from 1992 to 2001, an additional 7 firms were identified as out of business (total of 25), and no email addresses could be found for 893. For an additional 500 firms, the best email addresses that were found were also undeliverable. These 1,418 firms could not be contacted and thus had no opportunity to complete the surveys. Of these firms, 585 had mailing addresses known to be bad. The 1,418 firms that could not be contacted were responsible for 1,885 of the individual awards in the sample. Using the same methodology as the GAO had used in the 1992 report of their 1991 survey of SBIR, undeliverables and out of business firms were eliminated prior to determining the response rate. Although 4,085 firms were sur- veyed, 1,418 firms were eliminated as described. This left 2,667 firms, of which 1,239 responded, representing a 46 percent response rate by firms, which could respond. Similarly, when the awards, which were won by firms in the undeliver- able category, were eliminated (6,408 minus 1,885), this left 4,523 projects, of which 1,916 responded, representing a 42 percent response rate. Table App-B-1 displays by agency the number of Phase II awards in the sample, the number of those awards, which by having good email addresses had the opportunity to respond, and the number that responded. Percentages displayed are the percent- age of awards with good addresses, the percentage of the sample that responded, and the responses as a percentage of awards with the opportunity to respond. The NRC Methodology report had assumed a response rate of about 20 percent. Considering the length of the survey and its voluntary nature, the rate achieved was relatively high and reflects both the interest of the participants in the SBIR program and the extensive follow-up efforts. At the same time, the pos- sibility of response biases that could significantly affect the survey results must be recognized. For example, it may be possible that some of the firms that could not be found have been unsuccessful and folded. It may also be possible that unsuccessful firms were less likely to respond to the survey. Firm information and response percentages are not displayed in Table App-B-1, which displays by agency, since many firms received awards from multiple agencies. The average firm size for awards, which responded, was 37 employees. Nonresponding awards came from firms that averaged 38 employees. Since responding Phase IIs were more generally more recent than nonresponding, and awards have gradually grown in size, the difference in average award size ($655,525 for responding and $649,715 for nonresponding) seems minor.

APPENDIX B 141 TABLE App-B-1  NRC Phase II Survey Responses by Agency as of August 4, 2005 Percentage of Sample Awards Awards Answered Surveys Surveys as a Phase II with Good with Good Survey as a Percentage Sample Email Email as of Percentage of Awards Agency Size Addresses Addresses 8/4/2005 of Sample Contacted DoD 3,055 2,191 72 920 30 42 NIH 1,680 1,127 67 496 30 44 NASA 779 534 69 181 23 34 NSF 457 336 74 162 35 48 DoE 439 335 76 157 36 47 Total 6,408 4,523 70 1,916 30 42

142 APPENDIX B NRC Phase II Survey Results NOTE: RESULTS ARE FOR DOE. Survey responses appear in bold, and explanatory notes are IN A TYPEWRITER FONT. Project Information 157 respondents answered the first question. Since respondents are directed to skip certain questions based on prior answers, the number that responded varies by question. Also, some respondents did not complete their surveys. 148 com- pleted all applicable questions. For computation of averages, such as average sales, the denominator used was 157, the number of respondents who answered the first question. Where appropriate, the basis for calculations is provided after the question. PROPOSAL TITLE: AGENCY: DoE TOPIC NUMBER: PHASE II CONTRACT/GRANT NUMBER: Part I. Current status of the Project. 1. What is the current status of the project funded by the referenced SBIR award? Select the one best answer. Percentages are based on the 157 respondents who answered this question. a. 3% Project has not yet completed Phase II. Go to question 21. b. 21% Efforts at this company have been discontinued. No sales or addi- tional funding resulted from this project. Go to question 2. c. 17% Efforts at this company have been discontinued. The project did result in sales, licensing of technology, or additional funding. Go to ques- tion 2. d. 17% Project is continuing post-Phase II technology development. Go to question 3. e. 18% Commercialization is underway. Go to question 3. f. 24% Products/Processes/ Services are in use by target population/cus- tomer/consumers. Go to question 3. 2.����������������������������������������������������������������������������� Did the reasons for discontinuing this project include any of the following? ���������������������������������������������������������������������������� PLEASE SELECT YES OR NO FOR EACH REASON AND NOTE THE ONE PRIMARY REASON. 59 projects were discontinued. The % below is the percent of the discontinued projects that responded with the indicated response.

APPENDIX B 143 Primary Yes No Reason a. Technical failure or difficulties 41% 59% 25% b. Market demand too small 54% 46% 32% c. Level of technical risk too high 24% 76% 2% d. Not enough funding 53% 47% 12% e. Company shifted priorities 27% 73% 7% f. Principal investigator left 10% 90% 3% g. Project goal was achieved (e.g., prototype delivered for 49% 51% 5% federal agency use) h. Licensed to another company 10% 90% 7% i. Product, process, or service not competitive 31% 69% 5% j. Inadequate sales capability 10% 90% 0% k. Other (please specify): _____________________________ 7% 93% 2% The next question to be answered depends on the answer to Question 1. If c., go to Question 3. If b, skip to Question 16. Part II. Commercialization activities and planning. Questions 3-7 concern actual sales to date resulting from the technology devel- oped during this project. Sales includes all sales of a product, process, or service, to federal or private sector customers resulting from the technology developed during this Phase II project. A sale also includes licensing, the sale of technology or rights, etc. 3.������������������������������������������������������������������������� Has your company and/or licensee had any actual sales of products, proc- esses, services or other sales incorporating the technology developed during this project? Select all that apply. This question was not answered for those projects still in Phase II (3%) or for projects, which were discontinued without sales or additional funding (21%). The denominator for the percentages below is all projects that answered the survey. Only 76% of all projects, which answered the survey, could respond to this question. a. 16% No sales to date, but sales are expected. Skip to Question 8 b. 7% No sales to date nor are sales expected. Skip to Question 11 c. 39% Sales of product(s) d. 9% Sales of process(es) e. 22% Sales of services(s) f. 11% Other sales (e.g. rights to technology, licensing, etc.) From the combination of responses 1b, 3a and 3b, we can con- clude that 28% had no sales and expect none, and that 18% had no sales but expect sales.

144 APPENDIX B 4. For your company and/or your licensee(s), when did the first sale occur, and what is the approximate amount of total sales resulting from the technology developed during this project? If multiple SBIR awards contributed to the ������������������������������������������� ultimate commercial outcome, report only the share of total sales appropriate to this SBIR project. Enter the requested information for your company in the first column and, if applicable and if known, for your licensee(s) in the second column. Enter approximate dollars. If none, enter 0 (zero) Your Company Licensee(s) a. Year when first sale occurred 50% reported a year of first sale. 50% of these first sales occurred in 2000 or later. 19% reported a licensee year of first sale. 67% of these first sales occurred in 2000 or later. b. Total Sales Dollars of Product (s) Process(es) $ 582,783 $267,535 or Service(s) to date. (average of 157 survey respondents) Although 82 reported a year of first sale, only 74 reported sales >0. Their average sales were $ 1,115,817. 47% of the total sales dollars were due to 4 projects, each of which had $5,500,000 or more in sales. The highest reporting project had $17,515,000 in sales. Similarly of the 30 projects that reported a year of first licensee sale, only 7 reported actual licensee sales >0. Their average sales were $6,000,429. 76% of the total sales dollars was due to projects, each of which had 23,000,000 or more licensee sales. The highest reporting project had 31,926,000 in licensee sales. c. Other Total Sales Dollars (e.g., Rights to $ 45,556 $ 2,675 ��������������������������������������������������� (average of 157 technology, Sale of spin-off company, etc.) to date survey respondents) Combining the responses for b and c, the average for each of the 157 projects that responded to the survey is thus sales of over $625,000 by the SBIR company and over $270,000 in sales by licensees. Display this box for Questions 4 & 5 if project commercialization is known. Your company reported sales information to DoD as a part of an SBIR proposal or to NRC as a result of an earlier NRC request. This information may be useful in answering the prior question or the next question. You reported������ (date): as of DoD sales ($ amount), Other federal sales ($ amount), Export sales ($ amount), Private-Sector sales ($ amount), and other sales ($ amount).

APPENDIX B 145 5.������������������������������������������������������������������������� To date, approximately what percent of total sales from the technology developed during this project have gone to the following customers? If none enter 0 (zero). Round percentages. Answers should add to about 100%. 157 firms responded to this question as to what percent of their sales went to each agency or sector. Domestic private sector 76% Department of Defense (DoD) 2% Prime contractors for DoD or NASA 1% NASA 1% Agency that awarded the Phase II –% Other federal agencies (Pull down) 1% State or local governments 0% Export markets 14% Other (Specify)_____________ 1% The following questions identify the product, process, or service resulting from the project supported by the referenced SBIR award, including its use in a fielded federal system or a federal acquisition program. 6. Is a federal system or acquisition program using the technology from this Phase II? If yes, please provide the name of the federal system or acquisition program that is using the technology. 5% reported use in a federal system or acqui- sition program. 7. Did a commercial product result from this Phase II project? 15% reported a commercial product. 8. If you have had no sales to date ���������������������������������������� resulting from the technology developed during this project����������������������������������������������������������� , what year do you expect the first sales for your company or its licensee? Only firms that had no sales but answered that they expected sales got this question. 29% expected sales. The year of expected first sale is 71% of those expecting sales expected sales to occur before 2007. Please ��������������������� ���������������������������������������� note: If a NASA SBIR award, the prime contractor’s line will state “Prime contractors for NASA.” The “Agency that awarded the Phase II” will only appear if it is not DoD or NASA. The name of the actual awarding agency will appear.

146 APPENDIX B 9. For your company and/or your licensee, what is the approximate amount of total sales expected between now and the end of 2006 resulting from the technology developed during this project? If none, enter 0 (zero). This question was seen by those who already had sales and those w/o sales who reported expecting sales; however, averages are computed for all who took the survey since all could have expected sales. a. Total sales dollars of product(s), process(es) or services(s) expected between now and the end of 2006. $ 551,949 (average of 157 projects) b. Other Total Sales Dollars (e.g., rights to technology, sale of spin-off company, etc.) expected between now and the end of 2006. $ 107,325 (average of 157 projects) c. Basis of expected sales estimate. (Select all that apply.) a. 12% Market research b. 25% Ongoing negotiations c. 44% Projection from current sales d.   2% Consultant estimate e. 30% Past experience f. 33% Educated guess 10. How did you (or do you expect to) commercialize your SBIR award? a.   5% No commercial product, process, or service was/is planned. b. 19% As software c. 58% As hardware (final product, component, or intermediate hardware product) d. 32% As process technology e. 21% As new or improved service capability f.   0% As a drug g.   0% As a biologic h. 14% As a research tool i.   4% As educational materials j.   8% Other, please explain ______________________________ 11. Which of the following, if any, describes the type and status of marketing activities by your company and/or your licensee for this project? Select one for each marketing activity. This question answered by 117 firms, which completed Phase II and have not discontinued the ­project, w/o sales or additional funding.

APPENDIX B 147 Need Not Marketing activity Planned Assistance Underway Completed Needed a. Preparation of marketing plan 4% 3% 15% 44% 34% b. Hiring of marketing staff 3% 5%   9% 22% 61% c. Publicity/advertising 9% 6% 26% 29% 30% d. Test marketing 8% 5% 20% 18% 50% e. Market research 5% 5% 22% 34% 33% f. Other (Specify) 0% 0%   3%   3% 39% Part III. Other outcomes. 12. As a result of the technology developed during this project, which of the following describes your company’s activities with other companies and investors? Select all that apply. Percentage of the 117 who answered this question. U.S. Companies/Investors Foreign Companies/Investors Finalized Ongoing Finalized Ongoing Activities Agreements Negotiations Agreements Negotiations a.  Licensing Agreement(s) 15% 15% 5% 9% b.  Sale of company   1%   1% 1% 1% c.  Partial sale of company   3%   2% 0% 2% d.  Sale of technology rights   5%   6% 1% 3% e.  Company merger   0%   1% 0% 1% f.  Joint Venture agreement   3%   7% 0% 3% g. Marketing/distribution   9%   7% 9% 3% agreement(s) h.  Manufacturing agreement(s)   6%   6% 1% 4% i.  R&D agreement(s)   8% 10% 2% 6% j.  Customer alliance(s)   8% 13% 4% 5% k.  Other (Specify) __________   5%   3% 0% 1% 13. In your opinion, in the absence of this SBIR award, would your company have undertaken this project? Select one. Percentage of the 117 who answered this question. a.   1% Definitely yes b.   4% Probably yes (If selected a. or b. , Go to question 14.) c. 13% Uncertain d. 44% Probably not e. 38% Definitely not (If c., d. or e., skip to question 16.)

148 APPENDIX B 14. If you had undertaken this project in the absence of SBIR, this project would have been Questions 14 and 15 were answered only by the 5% who responded that they definitely or probably would have undertaken this project in the absence of SBIR. a.   0% Broader in scope b. 17% Similar in scope c. 83% Narrower in scope 15. In the absence of SBIR funding, (Please provide your best estimate of the impact.) a. The start of this project would have been delayed about an average of 11 months. 50% of the 6 firms expected the project would have been delayed. 33% anticipated a delay of at least 24 months. b. The expected duration/time to completion would have been 1) 83% Longer 2)   0% The same 3)   0% Shorter 17% No response c. In achieving similar goals and milestones, the project would be 1)   0% Ahead 2)   0% The same place 3) 83% Behind 17% No response 16. Employee information. Enter number of employees. You may enter fractions of full-time effort (e.g., 1.2 employees). Please include both part-time and full-time employees, and consultants, in your calculation.

APPENDIX B 149 Number of employees (if known) when Ave = 32 Phase II proposal was submitted. 1% report 0 30% report 1 - 5 28% report 6 - 20 18% report 21 - 50 10% report >100 Current number of employees. Ave = 54 2% report 0 17% report 1 - 5 33% report 6 - 20 22% report 21 - 50 14% report >100 Number of current employees Ave = 1.5 who were hired as a result of the 46% report 0 technology developed during this 49% report 1 - 5 Phase II project. 5% report 6 – 20 0% report >20 Number of current employees who Ave = 1.5 were retained as a result of the 43% report 0 technology developed during this 52% report 1 - 5 Phase II project. 3% report 6 – 20 0% report >20 17. The Principal Investigator for this Phase II award was a (check all that apply) a.   5% Woman b. 11% Minority c. 85% Neither a woman or minority 18. Please give the number of patents, copyrights, trademarks, and/or scientific publications for the technology developed as a result of this project. Enter numbers. If none, enter 0 (zero). Results are for 149 respondents to this question. Number Applied For/Submitted Number Received/Published 123 Patents 91 21 Copyrights 20 31 Trademarks 27 218 Scientific Publications 200

150 APPENDIX B Part IV. Other SBIR funding. 19. How many SBIR awards did your company receive prior to the Phase I that led to this Phase II? a. Number of previous Phase I awards. Average of 18. 28% had no prior Phase I, and another 36% had 5 or less prior Phase I. b. Number of previous Phase II awards. Average of 7. 40% had no prior Phase II, and another 36% had 5 or less prior Phase II. 20. How many SBIR awards has your company received that are related to the project/technology supported by this Phase II award? a. Number of related Phase I awards Average of 2; 50% had no prior related Phase I and another 42% had 5 or less prior related Phase I b. Number of related Phase II awards Average of 1; 62% had no prior related Phase II and another 37% had 5 or less prior related Phase II Part V. Funding and other assistance. 21. Prior to this SBIR Phase II award, did your company receive funds for research or development of the technology in this project from any of the following sources? Of 152 respondents. a. 26% Prior SBIR (Excluding the Phase I, which proceeded this Phase II.) b. 13% Prior non-SBIR federal R&D c.   3% Venture Capital d.   8% Other private company e.   5% Private investor f. 30% Internal company investment (including borrowed money) g.   3% State or local government h.   3% College or University i.   3% Other Specify _________ Commercialization of the results of an SBIR project normally requires additional developmental funding. Questions 22 and 23 address additional funding. Addi- tional Developmental Funds include non-SBIR funds from federal or private sector sources, or from your own company, used for further development and/or commercialization of the technology developed during this Phase II project. 22. Have you received or invested any additional developmental funding in this project? a. 63% Yes Continue. b. 37% No Skip to Question 24.

APPENDIX B 151 23. To date, what has been the total additional developmental funding for the technology developed during this project? Any entries in the Reported column are based on information previously reported by your firm to DoD or NAS. They are provided to assist you in completing the Developmental funding column. Previously reported information did not include investment by your company or personal investment. Please update this information to include breaking out Private investment and Other investment by subcat- egory. Enter dollars provided by each of the listed sources. If none, enter 0 (zero). The dollars shown are determined by dividing the total funding in that category by the 157 respondents who started the survey to determine an average funding. Ninety-three of these respondents reported any additional funding. Source Reported Developmental Funding a. Non-SBIR federal funds $_ _, _ _ _, _ _ _ $ 362,968 b. Private investment $_ _, _ _ _, _ _ _ (1) U.S. venture capital $0 (2) Foreign investment $ 124,522 (3) Other private equity $ 36,908 (4) Other domestic private company $ 224,358 c. Other sources $_ _, _ _ _, _ _ _ (1) tate or local S governments $ 2,025 (2) ollege or universities C $ 817 d. Not previously reported (1) Your own company (Including money you have borrowed) $ 156,621 (2) Personal funds $ 13,216 Total average additional developmental funding, all sources, per award $ 921,438

152 APPENDIX B 24. Did this award identify matching funds or other types of cost sharing in the Phase II Proposal? a. 58% No matching funds/co-investment/cost sharing were identified in the proposal. If a, skip to question 26. b. 42% Although not a DoD Fast Track, matching funds/co-investment/ cost sharing were identified in the proposal. c.   0% Yes. This was a DoD Fast Track proposal. 25. Regarding sources of matching or co-investment funding that were proposed for Phase II, check all that apply. The percentages below are com- puted for those 63 projects, which reported matching funds. a. 73% Our own company provided funding (includes borrowed funds). b. 13% A federal agency provided non-SBIR funds. c. 43% Another company provided funding. d.   2% An angel or other private investment source provided funding. e.   5% Venture Capital provided funding. 26. Did you experience a gap between the end of Phase I and the start of Phase II? a. 64% Yes Continue. b. 36% No Skip to question 29. The average gap reported by 95 respondents was 5 months. 3% of the respondents reported a gap of one or more years. 27. Project history. Please fill in for all dates that have occurred. This infor- mation is meaningless in aggregate. It has to be examined p ­ roject by project in conjunction with the date of the Phase I end and the date of the Phase II award to calculate the gaps. Date Phase I ended Month/ year Date Phase II proposal submitted Month /year 28. If you experienced funding gap between Phase I and Phase II for this award, select all answers that apply. a. 56% Stopped work on this project during funding gap. b. 33% Continued work at reduced pace during funding gap. c.   9% Continued work at pace equal to or greater than Phase I pace during funding gap. d.   3% Received bridge funding between Phase I and II. e.   3% Company ceased all operations during funding gap.  The words underlined appear only for DoD awards.

APPENDIX B 153 29. Did you receive assistance in Phase I or Phase II proposal preparation for this award? Of 148 respondents. a.   2% State agency provided assistance. b.   3% Mentor company provided assistance. c.   1% Regional association provided assistance. d.   8% University provided assistance. e. 86% We received no assistance in proposal preparation. Was this assistance useful? a. 60% Very useful b. 35% Somewhat useful c.   5% Not useful 30. In executing this award, was there any involvement by university faculty, graduate students, and/or university developed technologies? Of 148 respondents. 38% Yes 63% No 31. This question addresses any relationships between your firm’s efforts on this Phase II project and any University (ies) or College (s). The percentages are computed against the 148 who answered question 30, not just those who answered yes to question 30. Select all that apply. a.   0% The Principal Investigator (PI) for this Phase II project was at the time of the project a faculty member. b.   3% The Principal Investigator (PI) for this Phase II project was at the time of the project an adjunct faculty member. c. 23% Faculty member(s) or adjunct faculty member (s) work on this Phase II project in a role other than PI, e.g., consultant. d. 20% Graduate students worked on this Phase II project. e. 16% University/College facilities and/or equipment were used on this Phase II project. f.   1% The technology for this project was licensed from a University or College. g.   5% The technology for this project was originally developed at a University or College by one of the percipients in this phase II project. h. 18% A University or College was a subcontractor on this Phase II project. In remarks enter the name of the University or College that is referred to in any blocks that are checked above. If more than one institution is referred to, briefly indicate the name and role of each.

154 APPENDIX B 32. Did commercialization of the results of your SBIR award require FDA approval? Yes 1% In what stage of the approval process are you for commercializing this SBIR award? a. 0% Applied for approval b. 0% Review ongoing c. 0% Approved d. 0% Not approved e. 0% IND: Clinical trials f. 0% Other

Next: Appendix C: NRC Phase I Survey »
An Assessment of the SBIR Program at the Department of Energy Get This Book
×
Buy Hardback | $74.00 Buy Ebook | $59.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

The Small Business Innovation Research (SBIR) program is one of the largest examples of U.S. public-private partnerships. Founded in 1982, SBIR was designed to encourage small business to develop new processes and products and to provide quality research in support of the many missions of the U.S. government, including health, energy, the environment, and national defense. In response to a request from the U.S. Congress, the National Research Council assessed SBIR as administered by the five federal agencies that together make up 96 percent of program expenditures. This book, one of six in the series, reports on the SBIR program at the Department of Energy. It finds that, in spite of resource constraints, the DoE has made significant progress in meeting the legislative objectives of SBIR and that the program is effectively addressing the mission of the Department of Energy. The book documents the achievements and challenges of the program and recommends programmatic changes to make the SBIR program even more effective in achieving its legislative goals.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  6. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  7. ×

    View our suggested citation for this chapter.

    « Back Next »
  8. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!