Answers the question related to the topic "Quality of Measures"

True false/ Questions

47. In staffing the scores of individuals are treated as if they were the attribute itself, rather than merely indicators of the attribute.

48. The consistency of measurement of an attribute refers to its validity.

49. Perfect reliability is virtually impossible to achieve because of the presence of measurement error.

50. Calculation of the test-retest reliability of scores between time periods is done for objective measures, not subjective measures.

51. Comparing scores of objective measures within the same time period is a measure of internal consistency.

52. If all the members of a panel interview reach the same conclusion regarding a person who is being interviewed, it could be said that the interview ratings are reliable.

53. Even when measurement error is present, scores can be measured with perfect precision.

54. Error caused by failing to measure a key aspect of the attribute of interest (i.e., the attribute we wish to measure), is known as contamination error.

55. Asking different questions of job applicants during comparisons of interview ratings between these same job applicants is an example of contamination error.

56. If an attribute of job performance is "planning and setting work priorities," and the raters fail to rate people on that dimension during their performance appraisal, then the performance measure is contaminated.

57. A measure with a coefficient alpha of .55 should generally be regarding as having adequate reliability.

58. The standard error of measurement is a useful indicator of how accurate actual scores of applicants are in assessing the scores of a given measure.

59. Reliability sets the lower limit on validity.

60. The extent to which scores on a knowledge test truly reflect a job applicant's knowledge is a measure of the test's validity.

61. Measuring the accuracy of a mechanical ability test in predicting the job performance of current employees involves a predictive validity design.

62. Criterion measures are not used in the calculation of content validity.

63. Even if methodological and statistical differences across criterion-related validation studies are not controlled for statistically, it is still probable that validity can be generalized from one specific situation to another.

64. Organizations that collect assessment data need to attend to professional standards that govern their use.

65. The process of criterion-related validation begins with the identification of criterion measures.

66. The assessment of concurrent validity is more convenient and more efficient than the assessment of predictive validity.

67. One guideline for effective staffing practice is that all predictors should be routinely subjected to content validation.

Multiple Choice Questions

68. Reliability of measurement is defined as __________.
A. frequency of measurement
B. magnitude of measurement
C. accuracy of measurement
D. consistency of measurement


69. Which of the following is a statement?
A. score divided by error equals actual score
B. actual score equals score plus error
C. actual score plus error equals score
D. score equals variance plus error

70. Coefficient alpha assesses ____________.
A. reliability within a single time period
B. reliability between time periods
C. reliability between samples
D. test-retest reliability
E. A and B are correct

71. Comparing objective scores from T1 to T2 is a method for assessing _____ reliability.
A. maximal asymptotic
B. internal consistency
C. test-retest
D. interrater

72. Comparing the same supervisor's rating of an employee's performance at T1 to T2 is a method for assessing ______ reliability.
A. intrarater
B. fixed-point
C. test-retest
D. interrater

73. Reliability of a measure places ________.
A. no limit on the validity of a measure
B. a lower limit on the validity of a measure
C. an average limit on the validity of a measure
D. an upper limit on the validity of a measure


74. Deficiency error would not indicate a failure to _________.
A. measure some portion of the attribute of interest
B. adequately define the attribute of interest
C. construct a proper measure of the totality of the attribute
D. calculate the standard deviation

75. Contamination error _________.
A. is easy to minimize and control
B. is the same as deficiency error
C. represents unwanted sources of influence on a measure
D. shows a lack of an acceptable coefficient alpha

76. Which of the following is an example of contamination error?
A. irrelevant material on the test
B. guessing by the test taker
C. different time limits for the same test
D. all of the above

77. The standard error of measurement allows ________.
A. calculation of confidence intervals for scores
B. estimates of content validity
C. calculation of confidence intervals for actual scores
D. calculation of confidence intervals for error

78. Validity of a measure is best defined as ________.
A. the upper limit of reliability
B. the degree to which the measure does indeed measure what it is intended to measure
C. the lower limit of reliability
D. the consistency of measurement


79. Which of the following is a type of validity?
A. test-retest
B. coefficient alpha
C. criterion
D. parallel forms

80. When predictor and criterion scores have been obtained, the predictor can be considered valid if __________.
A. the correlation coefficient has the desired practical and statistical significance
B. the correlation coefficient has statistical significance alone
C. the correlation coefficient is insignificant
D. the correlation coefficient has practical significance alone

81. Content validation is most appropriate when ____________.
A. reliability is too high
B. sample size is large
C. criterion measures are readily available
D. sample size is too small for criterion validity calculation

82. The case for validity generalization across situations becomes stronger if ___.
A. correlation coefficients are negative
B. the standard error of measurement is large
C. differences in method and statistical differences are controlled
D. reliability is low

83. Which of the following is not part of the process of measurement?
A. choosing an attribute of concern
B. assessing the attribute's acceptability to applicants
C. using the measure to gauge the attribute
D. constructing a measure of the attribute