CWEA
SF Bay Section

 

Sewer Club Ink ... Online

[ Menu ]   [ Home ]

 

Articles Received in:
October 2000
(
Printed Issue:  November 2000)

Contents
San Francisco Bay Section Award Recognition
The TCP Exam - How Test Pass Points are Determined
News, Announcements, Upcoming Events  - Go to Home Page

San Francisco Bay Section Award Recognition

by Dave Williams, Bay Section President

The survey shows it…we see it everyday in our working environment…it is extremely important to every organization and it can be practiced by everyone. What I am talking about is recognition. That simple human act where one person says to another that what they did was noteworthy. However, in our modern workforce with our busy schedules and hectic pace, all too often, recognition is sadly lacking. I think most of us would agree that recognition should be practiced on a daily basis; but often times we just plain forget to do it. We have an excellent opportunity each year, however, within the San Francisco Bay Section to recognize all the good work that is done by individuals and organizations throughout the year and to place special recognition on those we feel that are the best. The opportunity that I am referring to is, of course, our annual awards banquet.

The San Francisco Bay Section has a long-standing tradition of each and every year holding its annual awards banquet in early February. It is one of the most festive events the Bay Section holds and is widely attended by individuals from all corners of our membership including our public agencies, consultants, manufacturers and industries. It is also the one time during the year when we see several of our elder statesmen from the Bay Section who have long since retired coming together to share the camaraderie and fellowship of our industry.

The opportunities at the annual awards banquet abound. There are recognition awards for individuals, organizations, and projects, plus we also take the opportunity to recognize special efforts on the part of individuals, such as outstanding service to the Section. CWEA strongly supports the local section awards and in fact many of our award winners go on to compete at the state level. Bay Section members have been successful on numerous occasions in being recognized at the annual CWEA conference as the best in the state.

But as you may imagine, the whole process of recognizing the best in our Section cannot be done overnight. There is a whole process consisting of distributing the nomination forms, assembling the judging committees, reconfirming the criteria that is used to evaluate the nominations, conducting detail reviews of the nominations, including site inspections and walk-throughs, arranging for the banquet hall facilities, arranging many other logistics in preparation for the festive occasion, including posters sessions, photography, audio/video, and many other activities that are required to have a successful event. However, there is one more very important factor and that is all of the effort and hard work will not result in a successful event without you…the San Francisco Bay Section members who come forward with all the nominations of those individuals, organizations and activities that are deserving of the recognition. I ask that you start thinking now about those individuals, organizations and projects that you feel are worthy of recognition and take the time to complete a nomination form.

There are many opportunities for recognition. The following are the listing of the awards of the San Francisco Bay Section:

  • Collection System of the Year
  • Collection System Person of the Year
  • Laboratory Analyst of the Year
  • Engineer Achievement Award
  • Research Achievement Award
  • Supervisor of the Year
  • Plant Safety Awards for small, medium and large plants
  • Industrial/Waste Hazardous Person of the Year
  • Industrial/Waste Hazardous Facility of the Year
  • Public Education Award for both Large and Small Budget Organization
  • Large Plant of the Year
  • Small Plant of the Year
  • Plant Operator of the Year
  • Mechanic/Technician of the Year

Nomination packages are currently available from any of your Board or Committee members. The deadline for the receipt of application is November 1, 2000 and anyone can submit a nomination.

Recognition is important. In fact, it is one of the most important thing that we can do. Please take the opportunity that is just around the corner to recognize an individual, an organization or project that your feel is deserving. The San Francisco Bay Section Awards Banquet continues to be an outstanding event within our industry, offering a wonderful evening of camaraderie with friends and colleagues and providing an opportunity to recognize those who are truly deserving.

Editor's Note: For more information regarding the Awards Program, and a link to the application forms on the CWEA website, see Alexis Halstead's announcement.

Back to Top

The TCP Exam - How Test Pass Points are Determined

The Pass Point
The test pass point is the minimum score required to pass a certification test. The pass point is also known as a cut score or passing score. Pass points for CWEA certification tests vary with each test, but usually they fall between 65% and 75% of all test items answered correctly. The pass point for each vocation and grade level is set independently. Also, each version, or form, of a test will have its own pass point. Different versions are given each time the certification test is administered.

How Pass Points Are Set
A modified Angoff Method is used to determine the pass point for each version of each test. The modified Angoff Method uses expert judgements to determine the difficulty level of the test. The easier the test, the higher the pass point. Likewise, the more difficult the test, the lower the pass point.

The following is a basic outline of the modified Angoff Method (some details have been omitted):

  1. A group of Subject Matter Experts (SMEs) independently rate each test question within a given test. The ratings are defined as the probability, or likelihood, that an acceptably (minimally) competent person with the requisite education and experience will answer the question correctly. An acceptably (minimally) competent person is defined as someone who adequately performs all job functions safely and requires no further training to do so.

  2. The SMEs review each test question as group. A consensus is reached for the rating of each test question. During this time the SMEs review comments submitted in writing by test-takers. Any test question that is judged to be ambiguous, has more than one correct answer, or has no correct answers is eliminated from the scoring process for that test. These test questions are then revised for future use, re-classified, or deleted form the test item bank.

  3. After the data are refined, the final step is to calculate the mean, or average, of all the test question ratings. This becomes the overall pass point estimation.

Why Use Modified Angoff?
Each version of a given certification test pulls questions from a test item bank. Each of these questions vary in difficulty. Because a different mix of questions is used in each test the overall difficulty level is not fixed. Thus, it is important to make sure that the varying difficulty level is reflected in the pass point of each test to ensure that test results are reliable. Test reliability is concerned with the reproducibility of results for each version of a given test. In other words, for a test to be reliable it must yield the same result (pass or fail) for the same individual under very similar circumstances. For example, image you take a certain grade level test and pass it. Immediately after completing this test you take the same grade level test, but a different version. If the test is reliable you will achieve the same result: pass. If you don’t, it is likely that the test is not a reliable measure of acceptable (minimal) competency.

By taking into consideration the difficulty level of the test, the modified Angoff Method significantly increases the reliability of the tests. Also, since each test is adjusted for difficulty level, each test version has the same standard for passing. Thus, test-takers are treated equitably and fairly even if they take different versions of the test.

There are other methods for setting pass points. However, for the type of tests administered by CWEA, the modified Angoff Method is the best.

Why Not Use 70% As The Pass Point?
Pass points are a critical component of any certification test. It is the standard at which those who have demonstrated minimal acceptable competence are separated from those who have not. Simply writing a test then setting the pass point at 70%, without any supporting rationale, leaves a lot of questions open such as: how do you know if a 70% pass point will result in all competent individuals passing and no one else passing?; why was 70% chosen?; how can a variety of different tests, that test different subjects at different grade levels, all have the same pass point?; and how do you know that the 70% pass point will result in reliable estimates of competence? If all of these questions can be answered adequately then 70% is an acceptable pass point. Simply answering that 70% is the traditional pass point is not acceptable. If a 70% pass point is determined under the modified Angoff Method then it can be stated that 70% is an acceptable pass point.

Certification Program Standards
Certification programs affect employment decisions and are therefore subject to certain standards set forth by federal law. To comply with these federal regulations, pass points must be set with consideration given to Standards of Educational and Psychological Testing (American Educational Research Association, American Psychological Association, and the National Council on Measurement in Education, 1985). CWEA utilizes methods of pass point determination that meet, or exceed, these standards.

Back to Top

 

Copyright SFBS-CWEA 2005.
Web site Editor:
    Mark Takemoto - RMC Water and Environment
    Phone: (925) 627-4100; Fax: (925) 627-4101
    email: cwea-sfbay@rmcwater.com 

Privacy Statement:
The CWEA SF Bay Section follows the privacy policy established by CWEA.  Please see the CWEA Privacy Statement

Last updated: May 04, 2005.