National Center for Fair & Open Testing accuses PCC of misusing “admissions” test

by David Safier

I love the take-all-comers aspect of community colleges which, unfortunately is coming to an end. It's a manifestation of one of the best — and most troublesome — aspects of our education system: the idea that American education gives people unlimited second chances. Like democracy, it's messy and inefficient. Also like democracy, it beats hell out of the other alternatives. But if you're starving education, limiting enrollment is inevitable. If you ask me, that's a damn shame, but if you ask a conservative, it's not a bug, it's a feature.

PCC has created hurdles to admissions which don't belong at the community college level. Worse, the main hurdle is a single test which wasn't designed to be used in that way. The National Center for Fair and Open Testing wrote a letter to the PCC Board of Governors condemning the practice.

It has recently come to our attention that Pima Community College is using the COMPASS exam, designed explicitly for course placement, as a de facto admissions test. Based on our review of the evidence, the COMPASS currently functions as the sole criterion to determine eligibility for credit-bearing courses, degree and certificate programs, and financial aid.

We are gravely concerned that Pima Community College's current policy appears to be a violation of the standards of the assessment profession, the test-makers' guidelines for proper use of exam results, and principles of good practice broadly supported by the college admissions community.

Even the company that makes the COMPASS exam doesn't condone its use as the sole criterion for admissions.

We counsel clients not to rely on assessment data as the sole criterion for making selection decisions, but to consider all available information that addresses additional relevant skills and abilities. We encourage our clients to consider other measures of knowledge, skills, and abilities (e.g., high school grades, supervisors' ratings) and various noncognitive factors (e.g., previous experience, interests, special skills)."

You can read the whole letter below the fold.

National Center for Fair & Open Testing   
June 14, 2012

Mr. Scott Stewart, Chairman
PCC Board of Governors
4905 E. Broadway Blvd. 
Tucson, Arizona 85709-1005      via email
Dear Chairman Stewart:

I write on behalf of the National Center for Fair & Open Testing (FairTest). Founded in 1985 by leaders of national education reform, civil rights and student activist groups, FairTest works to ensure that assessment at all levels is fair, open and educationally sound. During the past two-and-a-half decades, we have worked with admissions officials at many institutions to encourage uses of standardized test scores that promote equity and excellence.

It has recently come to our attention that Pima Community College is using the COMPASS exam, designed explicitly for course placement, as a de facto admissions test. Based on our review of the evidence, the COMPASS currently functions as the sole criterion to determine eligibility for credit-bearing courses, degree and certificate programs, and financial aid.

We are gravely concerned that Pima Community College's current policy appears to be a violation of the standards of the assessment profession, the test-makers' guidelines for proper use of exam results, and principles of good practice broadly supported by the college admissions community.
Specifically, the Standards for Educational and Psychological Testing, jointly published by the American Educational Research Association, American Psychological Association, and National Council on Measurement in Education (c. 1999) states in Standard 13.7: "In educational settings, a decision or characterization that will have major impact on a student should not be made on the basis of a single test score. Other relevant information should be taken into account if it will enhance the overall validity of the decision." (p. 146)

In addition, the Policies and Guidelines for Uses of Data from ACT-Owned Assessments (c. 2011 ACT), the company that makes COMPASS says:

"ACT Responsibilities

IIB1. We counsel clients not to rely on assessment data as the sole criterion for making selection decisions, but to consider all available information that addresses additional relevant skills and abilities. We encourage our clients to consider other measures of knowledge, skills, and abilities (e.g., high school grades, supervisors' ratings) and various noncognitive factors (e.g., previous experience, interests, special skills)."

adding under "Client Responsibilities":

"We encourage clients to:

IIB5. Use data from ACT-owned assessments, surveys, and job analyses only for purposes supported by validity evidence.

IIB6. Use assessment data in conjunction with other relevant information in making selection decisions"
And:

"IIB8. Regularly conduct validation studies supporting the use of the assessment in selection or qualification procedures with anticipated applicant populations, including protected subgroups."
Moreover, the National Association for College Admissions Counseling (NACAC) Statement of Principles of Good Practice (SPGP), widely endorsed by admissions professionals around the U.S., clearly states under "Mandatory Practices" for "Admissions, Financial Aid and Testing Policies and Procedures" that members should:
"6.1 not use minimum test scores as the sole criterion for admission, advising or for the awarding of financial aid;"

Unfortunately, Pima Community College is not currently listed as a NACAC member institution – if it were, a complaint to NACAC's  Admissions Practices Committee would also be in order.

Unless Pima Community College can demonstrate that its application of COMPASS test results complies with each of these guidelines, the use of that exam in the admissions process should be suspended immediately. Consistent with the guidance from all these expert sources, Pima Community College should never require a minimum test score requirement on any kind for applicants to its degree-granting programs.

Please let me know if you have any questions or need additional information. FairTest offers its assistance to the administration of Pima Community College to develop revised admissions procedures that comply with professional standards and assure equitable treatment for all applicants. I can be reached directly at (239) 395-6773 or by email at bobschaeffer@fairtest.org.

                                                                                        Sincerely,
                                                                                        Robert A. Schaeffer
                                                                                        Public Education Director


Discover more from Blog for Arizona

Subscribe to get the latest posts sent to your email.