Tuesday, July 30, 2019

2019 LEAP and EOC Conversion Tables

The LDOE claims steady growth in student LEAP scores
The Louisiana Department of Education recently announced the results of the Spring 2019 LEAP tests. The results statewide and by school district and school are available on the LDOE web site at links given at the bottom of the press release, here. These tables represent the LDOE's decisions on how many and what percentage of students achieved each level of achievement designated by the following categories: Unsatisfactory, Approaching Basic, Basic, Mastery, and Advanced.

The Department, in its press release, reports that Louisiana students are making steady improvement over last year on LEAP scores. This conclusion is based on the slight improvement in scale scores over last year, but since the LDOE has the authority to change the raw scores equivalent to scale scores, this conclusion is highly questionable.

The cut scores for each level of achievement may be manipulated
Each year the cut scores for each category of achievement remain the same, with the lowest passing score on LEAP tests (Basic) for grades 3-8 set at 725 points. However, the Department (LDOE) in consultation with its testing company sets the real raw scores equivalent to each level of achievement after the raw test results are in. Those raw cut scores change by a small amount each year. Some independent researchers, including myself, believe that this process allows the LDOE to manage or manipulate the reported performance of our students. Maybe that's why Louisiana's NAEP scores have dropped compared to our LEAP scores.

Scale scores are not really proportionate to the raw scores
Scale scores for each subject and grade tested run from a minimum of 650 to a maximum score of 850. If a student gets none of the answers right on a particular test she/he still gets the minimum score of 650. (This scale score seems to imply such students have actually achieved something even though they got nothing right) If the student gets all the points possible on a particular test he/she gets a score of 850. Other than those two end points, the scale score system does not tell us much about how many answers or points a student actually got right on a particular test. The actual points a student earns compared to the total possible points is called the "raw score". If we know the raw score and the total possible points on a particular test, we can calculate a raw percentage score by dividing the raw points earned by the total possible. The raw percentage score tells us how much of the material on the test a student actually got right. Unfortunately most parents never get to see their child's real raw percentage scores on state tests.

Using the "secret" conversion tables
Each year the LDOE and their testing companies create raw score to scale score conversion tables for each LEAP and End-of-Course test given. This should allow anyone to determine the scale score a student receives based on the number of points he got right on each test. But for some reason, the raw score to scale score conversion table is never made public on the LDOE web site. I believe the State Superintendent had originally intended to keep that information out of the reach of independent researchers and parents, but he was pressured to make the information available after receiving one of my public records requests that happened to be signed also by several key legislators. So now the raw score to scale score conversion tables are considered public records that can be obtained by any citizen upon making an official request. For the convenience of my readers, this third year in a row, I have requested the conversion tables. Each of the last three years, I have made the conversion tables available on my Google Docs site so that interested educators and parents could see how many points out of the total possible or what percentage each student scored on each of their state tests.

Shockingly low raw scores
This link will take you to my Google Docs site where you can scroll though the LEAP test conversion tables for the 2019 tests. So if you know a student's scale score on a particular test, you can look up how many points he/she got right on the test. Then if you divide that raw score by the total possible points on the test you can see what percentage of the test questions the student got right. Readers will find that these raw and raw percentage scores are shockingly low for most students. For example, the average cut score for Basic for grades 3 through 8 in ELA and math represents only 27% of the questions answered correctly. Some of the cut scores for a rating of Basic are as low as 22% (5th grade ELA)  and only 26% (7th grade math). Average statewide student performance in 2019 in ELA for grades 3 through 8 was only 38%. Average statewide student performance in 2019 in math for grades 3 through 8 was only 39%.

We learn by reviewing these conversion tables, how few answers a student has to get right to score a passing score of Basic. The passing raw percentage scores on LEAP vary quite a bit from test to test, but each year average about 30% for English and math. So students can pass most of the LEAP tests each year by knowing an average of less than one-third of the material on the test. Also the cut scores for Mastery are quite low, averaging 43% for ELA and only 51% for math. Maybe that's why Superintendent John White, who loves to brag about how he has raised school standards in Louisiana, was not anxious to make the raw scores easily available to the general public.

Raw cut scores for high school End of Course tests are ridiculously low
I have also received the raw score to scale score conversion tables for the high school End of Course tests for the 2018-2019 school year. Readers can click on this link to see the conversion tables for the English I, English II, Algebra I, Geometry, and American History End of Course tests for this past year. The cut scores for passing EOC tests are even lower than those for elementary and middle schools. Students only need to get a rating of "Approaching Basic" to get a passing score. The geometry test can now be passed by a student getting only 10.3% of the questions right.

Voucher students earn consistently lower scores than students who attend regular public schools
I requested and received the average scores (statewide) for public school students taking all of the LEAP and End of Course tests in the 2018-2019 school year and the 2017-2018 school years. Use this link to access the report of average LEAP scores. In addition, readers can use the same table to view the average scores of non-public school students. These are the students that have received "opportunity scholarships" to allow them to take their MFP money with them to attend a private school in Louisiana. This was Governor Jindal and John White's plan to allow students to "escape" so called "failing schools" and go to a school where they would get a better education. Unfortunately for the image of this highly touted program, the figures reported here show that for every grade and every test, the average scores for the students attending private schools at public expense are lower than the average scores for students attending public schools.