Publication Type: Conference Paper/Unpublished Manuscript
Review Method: Peer Reviewed
Abstract: Trace files, keystroke files, or audit trails, the automatic byproducts of most computer-assisted interviewing (CAI) software systems, have received increasing attention as tools for evaluating instrument and interviewer performance. Captured on an interview or case basis, these files typically provide data on times the interviewer entered and exited a field, actions invoked at specific items (e.g., requesting help, recording or changing comments or remarks, etc.), and, depending on the system, all keystrokes made during the interview. While limited in number, previous studies have demonstrated, or at least suggested, the utility of these files in identifying problematic survey items and screens and troubleshooting interviewer problems in the use of CAI software and instruments.

Using data from the first quarter of 2004 (approximately 10,000 cases), this paper will discuss the current exploration and use of Blaise audit trails with the National Health Interview Survey (NHIS), an ongoing population-based health survey conducted by the National Center for Health Statistics, Centers for Disease Control and Prevention. Results will be presented from analyses of interview, section, and item-level times; help screen access; the recording of interviewer notes; break-off episodes; and other audit-trail-based measures that may aid in evaluating instrument and item performance. Issues related to data processing and management, including data storage, will also be addressed. The paper will conclude with a discussion of data usability, the overall role of audit trails in monitoring data quality, and future directions for audit trail analysis within the NHIS.

Publication Type: Conference Paper/Unpublished Manuscript
Review Method: Peer Reviewed
Abstract: The critical incident technique is one of the current methods used in commu-ni-cation audits. There is an abundance of ‘how to’ information available about the method, and various case studies underline the method’s usefulness to investigate the quality of organizational communication. However, little is known about the way the method works: what kinds of incidents do employees report, and how can these incidents best be used to diagnose communication problems in an organi-za-tion. These questions are addressed in this paper, based on data that were collected among teachers, management and staff of a high school in the Netherlands.

Publication Type: Conference Paper/Unpublished Manuscript
Abstract: The preeminence of “prevention” is established in the National Strategy for Homeland Security (2002) and the demand for “preparedness” is established in the Homeland Security Presidential Directive 8 (2003). These documents served as the basis for the mandate to local jurisdictions to improve preparedness, particularly related to “prevention,” the most important but the most elusive of the components of Homeland Security. The Office of Domestic Preparedness (ODP) recently published guidelines to direct local law enforcement agencies in terrorism prevention strategies. This Preparedness audit will determine the level of compliance with those guidelines, specifying the obstacles to compliance, critical need areas, and model units. The audit will consist of interviews, focus group meetings, a review of policies and procedures, and surveys of officers.

Publication Type: Conference Paper/Unpublished Manuscript

Publication Type: Hands-on Presentation
Abstract: The National Energy Education Development (NEED) Project’s Energy Management Tools, provide students with the fundamentals of energy use, conservation and the science between them. Using the school building as the learning laboratory, students measure energy use, costs and environmental effects.