Contents

Methods for Evaluating and Auditing Credentialing Programs

With recent changes in the credentialing environment and in the technologies of credentialing assessment, organizations that are responsible for licensure and certification may benefit from a systematic evaluation of the programs they provide.

A program evaluation enables credentialing organizations to assess the extent to which the organization is meeting its credentialing goals and objectives. Moreover, an evaluation conducted at a time of transition enables credentialing organizations to be maximally informed before making critical policy decisions.

The PES Guidelines for the Development, Use, and Evaluation of Licensure and Certification Programs recommends an ongoing program of research, evaluation, and policy appraisal as a means of enhancing an organization's credentialing programs.

This issue of PES NEWS explores a number of different approaches to conducting program and organizational evaluations. The first article describes the work of a nursing credentialing organization in commissioning two external consultants to evaluate its 29 certification programs. The next article focuses on a licensure organization that employed a group of five stakeholders to evaluate its nine-part computerized examination.

Another article explores accreditation as a method of evaluating certification programs, by describing the accreditation process and standards used by the National Commission for Certifying Agencies. A final article in this issue examines the ways in which PES evaluates its own work through quality-control procedures, audits of computer systems to ensure year 2000 readiness, and independent audits of fee-sharing arrangements.

Also in this issue, we report on a new initiative by the Association of Test Publishers to develop a set of guidelines for computer-based testing.

For organizations that are considering conducting evaluation studies, or that are facing key policy decisions, we hope this newsletter will provide a valuable source of ideas and information. As always, we welcome your inquiries regarding evaluation and audit methodologies, and we encourage your comments on the issues addressed in this newsletter.

I. Leon Smith, Ph.D.
President & CEO