Dissertation Information for John James Regazzi IIINAME:
DEGREE:
DISCIPLINE:
SCHOOL: ADVISORS: COMMITTEE MEMBERS: MPACT Status: Incomplete - Inspected Title: A STUDY OF CRITICAL FACTORS AFFECTING THE DEVELOPMENT OF PERFORMANCE MEASURES IN EVALUATING BIBLIOGRAPHIC INFORMATION RETRIEVAL SYSTEMS Abstract: This study is an investigation into critical factors which would constitute reliable performance measures for bibliographic information retrieval systems. Thirty-two (32) judges, grouped by type of judge (researcher or student), level (senior or junior), speciality (biomedicine or social science), and evaluation context (relevance or utility), were asked to rate sixteen (16) documents on alcohol studies which included four (4) different search topics and four (4) document citations and abstracts for each search topic. These searches were taken from the Alcohol Information Retrieval System (AIRS). Half of the judges were asked to rate the documents on how relevant the documents were to the search topic; the other half rated the same documents on the basis of the document's perceived utility for the individual judge. The topics and documents were presented in a controlled prescribed order, so as to test the effects of order on the evaluation process. After rating the documents, judges were also asked to rate the importance of five (5) document attributes (author, title, abstract, source of publication, and date of publication) and six (6) information attributes (accuracy, completeness, subject, suggestiveness, timeliness, and treatment). Statistical tests of analysis of variance and discriminant analysis were used to analyze the data. |
MPACT Scores for John James Regazzi IIIA = 0 Advisors and Advisees Graph |