Advancing the Science of Direct Observation in Emotional and/or Behavioral Disorders Research: Reliability and Unified Validity

Adamson R. M. , & Wachsmith S. T. (2014). A review of direct observation research within the past decade in the field of emotional and behavioral disorders. Behavioral Disorders, 39, 181–189.

American Educational Research Association (AERA), American Psychological Association (APA), & National Council on Measurement in Education (NCME). (1999). Standards for educational and psychological testing (3rd ed.). Washington, DC: American Educational Research Association.

Baer D. M. , Harrison R. , Fradenburg L. , Petersen D. , & Milla S. (2005). Some pragmatics in the valid and reliable recording of directly observed behavior. Research on Social Work Practice, 15(6), 440–451.

Baer D. M. , Wolf M. M. , & Risley T. R. (1987). Some still-current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 20, 313–327.

Chafouleas S. M. , McDougal J. L. , Riley-Tillman T. C. , Panahon C. J. , & Hilt A. M. (2005). What do daily behavior report cards (DBRCs) measure? An initial comparison of DBRCs with direct observation for off-task behavior. Psychology in the Schools, 42, 6, 669–676. doi:10.1002/pits.20102

Cooper J. O. , Heron T. E. , & Heward W. L. (2007). Applied behavior analysis (2nd ed.). Upper Saddle River, NJ: Pearson.

Creswell J. W. (2002). Educational research: Planning, conducting, and evaluating quantitative and qualitative research. Upper Saddle River, NJ: Merrill Prentice Hall.

Cronbach L. J. (1988). Five perspectives on validation argument. In Wainer H. , & Braun H. (Eds.), Test Validity (pp. 3–17). Hillsdale, NJ: Erlbaum.

Cronbach L. J. , & Meehl P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302.

Gage N. A. , Prykanowski D. , & Hirn R. G. (2014). Increasing reliability of direct observation measurement approaches in emotional and/or behavioral disorders research using generalizability theory. Behavioral Disorders, 39, 228–244.

Gersten R. , Baker S. K. , Haager D. , & Graves A. W. (2005). Exploring the role of teacher quality in predicting reading outcomes for first-grade English learners: An observational study. Remedial and Special Education, 26, 197–206.

Hintze J. M. (2005). Psychometrics of direct observation. School Psychology Review, 34, 507–519.

Horner R. H. , Carr E. G. , Halle J. , McGee G. , Odom S. , & Wolery M. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children, 71, 165–179.

Horovitz M. , & Matson J. L. (2012). In vivo assessment: Issues of real-time data. In Matson J. L. (Ed.), Functional assessment for challenging behaviors (pp. 143–158). New York: Springer.

Kazdin A. E. (2011). Single-case research designs: Methods for clinical and applied settings (2nd ed.). New York: Oxford University Press.

Kratochwill T. R. , Hitchcock J. , Horner R. H. , Levin J. R. , Odom S. L. , Rindskopf D. M. , & Shadish W. R. (2010). Single-case designs technical documentation. Retrieved from What Works Clearinghouse website: http://ies.ed.gov/ncee/wwc/pdf/reference_resources/wwc_scd.pdf

Lewis T. J. , Scott T. M. , Wehby J. H. , & Wills H. P. (2014). Direct observation of teacher and student behavior in school settings: Trends, issues and future directions. Behavioral Disorders, 39, 190–200.

McComas J. J. , Vollmer T. R. , & Kennedy C. (2009). Descriptive analysis: Quantification and examination of behavior-environment interactions. Journal of Applied Behavior Analysis, 42, 411–412. doi:10.1901/jaba.2009.42-411

Messick S. (1988). The once and future issues of validity: Assessing the meaning and consequences of measurement. In Wainer H. , & Braun H. I. (Eds.), Test validity (pp. 49–60). Hillsdale, NJ: Lawrence Erlbaum Associates.

Miller F. G. , Chafouleas S. M. , Riley-Tillman T. C. , & Fabiano G. A. (2014). Teacher perceptions of the usability of school-based behavior assessments. Behavioral Disorders, 39, 201–210.

Pustejovsky J. E. , & Runyon C. (2014). Alternating renewal models for behavioral observation: Simulation methods, software, and validity illustrations. Behavioral Disorders, 39, 211–227.

Shadish W. R. , Cook T. D. , & Campbell D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Belmont, CA: Wadsworth.

Stichter J. P. , & Riley-Tillman T. C. (2014). Considering systematic direct observation after a century of research—Commentary on the special issue. Behavioral Disorders, 39, 245–247.

Wirth O. , Slaven J. , & Taylor M. A. (2014). Interval sampling methods and measurement error: A computer simulation. Journal of Applied Behavior Analysis, 47, 83–100. doi:10.1002/jaba.93