Two samples of entrepreneurs and small business owners who received assistance from entrepreneurship training programs were used to Investigate the relationships between (1) subjective measures of client satisfaction, (2) perceptions of performance Improvements attributable to the programs, and (3) objective measures of post-assistance business performance. The results show that subjective measures are not correlated with either attributions of performance or actual performance. Clients’ attributions of the portion of performance improvements attributed to the programs are generally correlated with the objective measurements. An implication seems to be that program evaluations relying exclusively upon participants’ satisfaction or subjective judgments of program effectiveness may lead to erroneous conclusions about a program's impact on venture performance. Conversely, measures of attribution, used In conjunction with objective measures, may be useful to support claims for causal connections between assistance programs and subsequent client performance.
Get full access to this article
View all access options for this article.
References
1.
BartikT. J. (1994). Better evaluation is needed for economic development programs to thrive. Economic Development Quarterly, 8 (2), 99–106.
2.
BrushC. G., & VanderwerfP. A. (1992). A comparison of methods and sources for obtaining estimates of new venture performance. Journal of Business Venturing, 7, 157–170.
3.
Bentley Clark Associates, Inc. (1979). Small Business Development Centers. Report prepared for the Sub-committee on SBA and SBIC Authority and General Small Business Problems of the Committee on Small Business, House of Representatives, 96th Congress, 1st Session, Washington, DC, October 11.
4.
BygraveW. D., & TimmonsJ. A. (1992). Venture capital at the crossroads.Boston: Harvard Business School Press.
5.
Centaur Associates, Inc. (1983). An evaluation of the economic impact of the Small Business Development Center program.Washington, DC: Small Business Administration.
6.
CharneyA., & LibecapG. D. (2000). The impact of entrepreneurship education.Kansas City: Insights: A Kaufman Research Series.
7.
ChrismanJ. J. (1989). Strategic, administrative, and operating assistance: The value of outside consulting to pre-venture entrepreneurs. Journal of Business Venturing, 4 (6), 401–418.
8.
ChrismanJ. J. (1997). Program evaluation and the venture development program at the University of Calgary: A research note. Entrepreneurship Theory and Practice, 22 (1), 59–73.
9.
ChrismanJ. J. (1998). The economic impact of Small Business Development Center counseling activities in the United States: 1996–1997.Washington, DCAssociation of Small Business Development Centers.
10.
ChrismanJ. J. (1999). The influence of outsider-generated knowledge resources on venture creation. Journal of Small Business Management, 37 (4), 42–58.
11.
ChrismanJ. J., & CarsrudA. L. (1989). Outsider contributions to the development and change of business ventures. Journal of Organizational Change Management, 2 (3), 75–87.
12.
ChrismanJ. J., & CarsrudA. L. (1991). Outsider assistance needs of pre-venture and established small businesses: A comparison of minority and nonminority clients. Entrepreneurship and Regional Development, 3 (3), 207–220.
13.
ChrismanJ. J., CarsrudA. L., DeCastroJ., & HerronL. (1990). A comparison of assistance needs of male and female pre-venture entrepreneurs. Journal of Business Venturing, 5 (4), 235–248.
14.
ChrismanJ. J., & KatrishenF. (1994). The economic impact of Small Business Development Center counseling activities in the United States: 1990–1991. Journal of Business Venturing, 9, 271–280.
15.
ChrismanJ. J., & McMullanW. E. (2000). A preliminary assessment of outsider assistance as a knowledge resource. The longer-term impact of new venture counseling. Entrepreneurship Theory and Practice, 24 (3), 37–53.
16.
ChrismanJ. J., McMullanW. E., & VesperK. (1998). Western Entrepreneurial Network: Review of programming 1998 final report.Denver, CO: U.S. West Foundation.
17.
ClarkB. W., DavisC. H., & HarnishV. C. (1984). Do courses in entrepreneurship aid in new venture creation?Journal of Small Business Management, 28 (2), 26–311.
18.
DowallD. (1996). An evaluation of California's enterprise zone programs. Economic Development Quarterly, 10 (4), 352–368.
19.
ElstrottJ. B. (1987). Procedure for improving the evaluation of SBDC consulting activities. Journal of Small Business Management, 25 (1), 67–71.
20.
FellerI., & AndersonG. (1994). A benefit-cost approach to the evaluation of state technology development programs. Economic Development Quarterly, 8 (2), 127–140.
21.
GillanL. M., & PoweM. (1994). Added value from teaching entrepreneurship and innovation. In BygraveW. D., BirleyS., ChurchillN.C., GatewoodE., HoyF., KeeleyR. H., and WetzelW. E.Jr. (Eds.), Frontiers of entrepreneurship research, pp. 687–689. Boston, MA: Babson College.
22.
GillanL. M., PoweM., DewsA. L., McMullanW. E. (1996) An empirical assessment of the returns to investment in entrepreneurial education. In ReynoldsP. D., BirleyS., ButlerJ. E., BygraveW. D., DavidssonP., GartnerW. B., and McDougallP. P. (Eds.), Frontiers of entrepreneurship research, pp. 638–639. Boston, MA: Babson College.
23.
GrantD. S., WallaceM., & PitneyW. D. (1995). Measuring state-level economic development programs, 1970–1992. Economic Development Quarterly, 9 (2), 134–145.
24.
GreenwaldA. G., (1997). Validity concerns and usefulness of student ratings of instruction, American Psychologist, 52 (11), 1182–1186.
25.
HansonG. S. (1993). Evaluation of state lender commitment programs. Economic Development Quarterly, 7 (3), 255–266.
26.
HawesJ. M., & CrittendenW. F. (1984). A taxonomy of competitive retailing strategies. Strategic Management Journal, 5, 275–287.
27.
HerrickB., & KindlebergerC. P. (1983). Economic development.New York: McGraw-Hill.
28.
JenkinsN. T., & BennettM. I. J. (1999). Toward an empowerment zone evaluation. Economic Development Quarterly, 13 (1), 23–28.
29.
JohnsonA. T., & SackA. (1996). Assessing the value of sports facilities: The importance of noneconomic factors. Economic Development Quarterly, 10 (4), 369–381.
30.
KanukL., & BerensonC. (1975). Mail surveys and response rates: A literature review. Journal of Marketing Research, 22, 440–453.
31.
KirkpatrickD. L. (1982). How to improve performance through appraisal and coaching.New York: Amacom.
32.
KirkpatrickD. L. (1983). A practical guide for supervisory training and development.Reading, MA: Addison-Wesley.
33.
KirkpatrickD. L. (1985). How to manage change effectively.San Francisco: Jossey-Bass.
34.
KirkpatrickD. L. (1993). How to train and develop supervisors.New York: Amacom.
35.
LangJ. R., & GoldenP. A. (1989). Evaluating the efficiency of SBDCs with data envelopment analysis: A longitudinal approach. Journal of Small Business Management, 27 (2), 42–49.
36.
MesconT. A. (1987). The entrepreneurial institute: Education and training for minority small business owners. Journal of Small Business Management, 25 (1) 61–66.
37.
McMullanW. E., LongW. A., & GrahamJ. B. (1986). Assessing economic value added by university-based new venture outreach programs. Journal of Business Venturing, 1, 225–240.
38.
NahavandiA., & ChesteenS. (1988). The impact of consulting on small business: A further examination. Entrepreneurship Theory and Practice, 13 (1), 29–40.
39.
OppenheimA. N. (1966). Questionnaire design and attitude measurement.New York: Basic Books.
40.
OverallJ. U., & MarshH. W. (1980). Students' evaluations of instruction: A longitudinal study of their stability. Journal of Educational Psychology, 72 (3), 321–325.
41.
PelhamA. (1985). Should the SBDC program be dismantled?American Journal of Small Business, 10 (2), 41–51.
42.
PriceC., & FlemingD. (1991). Four year study of Colorado entrepreneurship with minority and women business owners. In (Eds.), Frontiers of entrepreneurship research, pp. 49–63. (Publ.)
43.
PriceC., AllenK., & MonroeS. (1994) The effects of geographical and socio-economic differences on the replicability of entrepreneurial training programs. In BygraveW. D., BirleyS., ChurchillN. C., GatewoodE., HoyF., KeeleyR. H., and WetzelW. E.Jr. (Eds.), Frontiers of entrepreneurship research, pp. 698–700. Boston, MA: Babson College.
44.
PriceC., & MonroeS. (1993). Educational training for women and minority entrepreneurs positively impact venture growth and development. In ChurchillN. C., BirleyS., DoutriauxJ., GatewoodE., HoyF., and WetzelW. E.Jr. (Eds.), Frontiers of entrepreneurship research, pp. 594–596. Boston, MA: Babson College.
45.
ReeseL. A., & FasenfestD. (1997). What works best?: Values and the evaluation of economic development policy. Economic Development Quarterly, 11 (3), 195–207.
46.
ReitanB. (1997). Fostering technical entrepreneurship in research communities: Granting scholarships to would-be entrepreneurs. Technovation, 17 (6), 287–296.
47.
RobinsonP., & SextonE. (1994). The effect of education and experience on self-employment success. Journal of Business Venturing, 9 (2), 141–156.
48.
RobinsonR. B.Jr. (1982). The importance of ‘outsiders’ in small firm strategic planning. Academy of Management Journal, 25, 80–93.
49.
SchumpeterJ. A. (1934). The theory of economic development.New Brunswick, NJ: Transaction Publishers.
50.
ShermanH., & ChappellD. S. (1998). Methodological challenges in evaluating business incubator outcomes. Economic Development Quarterly, 12 (4), 313–321.
51.
SolomonG. T., & WeaverK. M. (1983). Small Business Institute economic impact evaluation. American Journal of Small Business, 8 (1), 41–51.
52.
StoreyD. (2000). Six steps to heaven: Evaluating the impact of public policies to support small business in developed economies. In SextonD., & LandstromH. (Eds.), Handbook of entrepreneurship, pp. 176–193. Oxford: Blackwell.
