Unfortunately, this integrated descriptive account is rarely the subject of research inquiry. It would seem to follow that researchers should examine the reliability of this descriptive narrative rather than the reliability of individual scale scores. Rather, information from scores on multiple scales is integrated into a descriptive account of the examinee. In contrast, however, the MMPI-2 is typically not interpreted one scale at a time when applied clinically. These examples all represent methods of evaluating the reliability of scores on individual scales. Minnesota Multiphasic Personality Inventory–Second edition (MMPI2) reliability has been conceptualized within several contexts, such as test–retest reliability (Butcher, Graham, Ben-Porath, Tellegen, Dahlstrom, & Kaemmer, 2001), temporal stability (Graham, 2011a), and internal consistency (Butcher et al., 2001). Therefore, reliability can be operationalized in a variety of ways. Keywords computer-based test interpretation, MMPI-2, q-sort, test interpretation, reliability The definition of test reliability and the methods used to estimate it ultimately depend on the attribute being measured and the sources of inconsistency thought to be present in the measurement of that attribute. In practice, users should consider that certain MMPI-2 profiles are interpreted more or less consensually and that some CBTIs show variable reliability depending on the profile. Some specific CBTI/ profile combinations (e.g., the CBTI by Automated Assessment Associates on a within normal limits profile) and specific profiles (e.g., the 4/9 profile displayed greater interprogram reliability than the 2/4 profile) were interpreted with variable consensus (α range =. Results revealed no significant differences overall with regard to interrater and interprogram reliability. Profile inferences drawn by four raters were operationalized using q-sort methodology. Evaluation of CBTI reliability comprised examination of (a) interrater reliability, the degree to which raters arrive at similar inferences based on the same CBTI profile and (b) interprogram reliability, the level of agreement across different CBTI systems. Williams3Ībstract The reliability of six Minnesota Multiphasic Personality Inventory–Second edition (MMPI-2) computer-based test interpretation (CBTI) programs was evaluated across a set of 20 commonly appearing MMPI-2 profile codetypes in clinical settings. Interpretive Reliability of Six ComputerBased Test Interpretation Programs for the Minnesota Multiphasic Personality Inventory–2Īssessment 1–12 © The Author(s) 2015 Reprints and permissions: /journalsPermissions.nav DOI: 10.1177/1073191115584970