This paper describes the development of a new type of selection procedure, the activity/achievement indicator (A/AI), and compares it with the behavioral consistency method of training and experience evaluation. Total scores from these two methods were found to correlate at r = .58. Examination of the six dimension scores of each method by means of the multitrait-multimethod matrix technique revealed convergent validity for only two of the dimensions, and discriminant validity for none. Implications of the findings are discussed.
Get full access to this article
View all access options for this article.
References
1.
AshR. A.“The behavioral consistency method of training and experience evaluation: Content validity issues and completion rate problems.”Public Personnel Management12, (1983), 115–127.
2.
AshR. A.“A comparative study of the behavioral consistency and wholistic judgment methods of job applicant training and work experience evaluation.”Public Personnel Management13, (1984), 157–172.
3.
AshR. A.LevineE. L.An investigation of career service unassembled examinations.University of South Florida, Center for Evaluation Research, December 1981.
4.
AshR. A.LevineE. L.“Job applicant training and work experience evaluation: An empirical investigation,” in AshR. A.ChairAshR. A.Chair, Current perspectives on job applicant training and work experience evaluation. Symposium presented at the annual meeting of the American Psychological Association, Washington, D.C., August 1982.
5.
CampbellD. T.FiskeD. W.“Convergent and discriminant validation by the multitrait-multimethod matrix.”Psychological Bulletin56, (1959), 81–105.
6.
CampbellJ. P.DunnetteM. D.ArveyR. D.HellervikL. V.“The development and evaluation of behaviorally based rating scales.”Journal of Applied Psychology57, (1973), 15–22.
7.
CookC. L.“Rating education, training, and experience in the public sectors.” Paper presented at the annual conference of the International Personnel Management Association Assessment Council, Boston, MA, July, 1980.
8.
JohnsonJ. C.GuffeyW. L.PerryR. A.“When is a T&E rating valid?” Paper presented at the annual conference of the International Personnel Management Association Assessment Council, Boston, MA, July 1980.
9.
LawtonJ. R.“A study of return rates and applicant qualifications in the behavioral consistency model.” In AshR. A.Chair: T&E evaluation: Additional experiences and research evidence pertaining to the behavioral consistency method. Symposium presented at the annual conference of the International Personnel Management Association Assessment Council, Minneapolis, MN, June 1982.
10.
LevineE. L.FloryA.III“Evaluation of job applicants: A conceptual framework.”Public Personnel Management4, (1975), 378–385.
11.
MentoA. J.“The behavioral consistency selection procedure for entry level selection.” Paper presented at the annual meeting of the American Psychological Association, Montreal, Canada, September 1980.
12.
PorterW. R.LevineE. L.FloryA.III. Training and experience evaluation.Tempe, AZ, Personnel Services Organization, 1976.
13.
SackettP. R.AshR. A.“Factors affecting the amount of time people will spend completing job application materials.” in AshR. A.Chair, T&E evaluation: Additional experiences and research evidence pertaining to the behavioral consistency method. Symposium presented at the annual conference of the International Personnel Management Association Assessment Council, Minneapolis, MN, June 1982.
14.
SchmidtF. L.CaplanJ. R.BemisS. E.DecuirD.DunnL.AntoneL.The behavioral consistency method of unassembled examining. —TM-79-21— Washington, D.C.: U.S. Office of Personnel Management, Personnel Research and Development Center, November 1979.
15.
SmithP. C.KendallL. M.“Retranslation of expectations: An approach to the construction of unambiguous anchors for rating scales.”Journal of Applied Psychology47, (1963), 149–155.
16.
WallaceR. S.“Criteria for What?”American Psychologist20, (1965), 411–417.
17.
WernimontP. F.CampbellJ. P.“Signs, samples and criteria.”Journal of Applied Psychology52, (1968), 372–376.
18.
WherryR. J.“An alternative and diagnostic forced-choice rating scale for servicemen.”Personnel Psychology12, (1959), 227–236.
19.
WhiteO. K.“Update on the use of the behavioral consistency approach to unassembled examining in the Federal Government.” in AshR. A.Chair, T&E evaluation: Additional experiences and research evidence pertaining to the behavioral consistency method. Symposium presented at the annual conference of the International Personnel Management Association Assessment Council, Minneapolis, MN, June 1982.
20.
ZedeckS.JacobsR.KafryD.“Behavioral expectations: Development of parallel forms and analysis of scale assumptions.”Journal of Applied Psychology61, (1976), 112–115.
