Sunday, August 17, 2014

LEAP Scores Manipulated

Public Records Request Reveals Significant Lowering of the 2014 LEAP Passing Requirement

On June 10 of this year, following release of the 2014 LEAP test scores, I filed a public records request to Superintendent John White as custodian of public records for the LDOE in an effort to find out how student passing scores were determined for the new Common Core aligned tests given this Spring. This press release from the LDOE had claimed that even though the new Common Core partially aligned tests were more difficult, the percentage of students passing the test (students who scored at the basic or above level) had remained steady.

After more than 2 months of stalling by the LDOE, I received an email from Barry Landry of the LDOE on August 14 providing me with the minimum percentage scores needed for students to pass the ELA and math portions of the 2014 LEAP test for 4th and 8th grades compared to previous years. The LDOE has still not provided me with the cut percentages for the mastery ratings I requested. Coincidentally, my lawsuit on this violation of the public records law was also filed Thursday, August 14. It is my hope that the court will order John White to also produce the minimum percentage results for the mastery level rating. The press release referred to above announced that more students were achieving a level of mastery in ELA and math than the year before. I am anxious to examine the basis for that alleged improvement. Meanwhile, the suspicions expressed in my post of July 27, have been confirmed.

It turns out that the number of correct answers required for a passing score (or a level of basic) was significantly reduced for three out of four categories of the LEAP high stakes testing. Once one knows how the passing scores are routinely manipulated it's no surprise that the percentage of students scoring basic or above remained steady. The test grading scale for LEAP was adjusted or "equated" (to use the lingo of testing experts), apparently to make certain that the perceived performance of students on the new Common Core aligned tests remained steady.

For example, in 2013, 4th grade students taking the ELA test needed to get 51.54% of the answers correct in order to get a scale score of 301 for a level of basic, but in 2014, after the annual "equating of test forms", students only needed to get 44.62% of the answers correct in order to get the minimum scale score of 301 needed for the level of basic.  So the members of general public who don't know the obscure workings of the testing industry, were given the impression that students did just as well on a harder test. But this only happened because students got a rating of basic on the 2014 ELA test by answering fewer questions right. The excuse used by the LDOE and the testing company for lowering the percent of correct answers needed is that since this year's test was harder, an equating calculation was applied which resulted in a lower percent of correct answers needed for passing. Okay, we get the picture. But you can't have it both ways. If you lowered the cut percentage score to adjust for the harder test, then you can't claim that the students performed just as well on the more difficult test!

There is another issue here in setting these cut scores in this manner that begins to strain credibility. It is well known that on a multiple choice test with 4 choices, a student who knows absolutely nothing can get 25% correct answers just by guessing. Teachers who prepare these kids for their tests advise them to guess at any questions they do not know so as to maximize their score. But the lower the equated cut percentage gets, the more that guessing can figure into the passing score. For example on this ELA example above, Herb Bassett (a highly qualified math teacher), calculates that a student could pass on the average by just really knowing only 26.2% of the material and getting the rest of his right answers by guessing. So is this where the new Common Core standards are taking us? Is it really a rigorous standard when a student can get a passing score in English Language Arts by knowing only 26% of the material.

Here is the table supplied by the LDOE as a result of my public records request:
 
Percentage of Total Raw Score Points Required to Earn “Basic”
ELA
Math
Science
Social Studies
4th
2014
44.62%
47.22%
58.93%
53.03%
2013
51.54%
50%
56.90%
56.06%
2012
53.85%
52.78%
62.07%
57.58%
8th
2014
58.70%
40.13%
58.93%
50%
2013
57.97%
48.61%
56.90%
52.63%
2012
57.97%
55.26%
56.90%
52.63%


Notice that for 4th grade ELA, 4th grade Math, and 8th grade Math, there was a significant lowering of the percentage of correct answers needed to get a rating of basic. The Science and Social Studies percentages were changed very little from 2013 to 2014.

Would you like to know why such a high percentage of our students (64%) were able to reach the level of Basic this year on a more difficult 8th grade Math test? Herb Bassett calculates that using the same method of guessing described above, 8th grade students this year on the average would need to know only 20.2% of the math material on the test to reach the level of Basic.

John White has said he is certain that our student test scores will improve steadily as Common Core is implemented in the next few years in Louisiana. I wonder how he knows that? Readers this is a test of your critical thinking skills. How do you think John White knows that our percentage of basic and mastery level students will go up in the next few years? Please send me your comments on this.

Here is a post recommended by Diane Ravitch about how the New York testing scores are being manipulated.  Do you get the feeling, as I do, that we are all being taken for a ride by the con men of the testing industry and our "Rainmaker" superintendent borrowed from New York?  Is there any validity to the claim that the new Common Core tests are more "rigorous" than the old standards if the testing company systematically lowers the cut score percentages to a level so low that students can come close to passing by guessing?

We know only one thing for sure about adopting new standards and this constant testing and "test equating". As long as we allow our children's education to remain in the grip of the testing companies and the corporate reformers, those companies will continue to make millions off of our students and taxpayers.

15 comments:

Anonymous said...

Will you be able to provide this information for other grade levels as well?

Michael Deshotels said...

I wanted to start with a simple request so I just asked for the high stakes results of 4th and 8th grades. Once we get these answers I intend to ask for the equating information for all tests.

Anonymous said...

Were the percentages set before or after the tests were scored in Louisiana?? Or do you know?? Just curious.

Anonymous said...

It makes sense that the passing rates were set after they were graded...it is a customary curve determined only after seeing the scores and then needing to manipulate the numbers to get the desired results that won't set off media alarms. However, mike is a realist and after a short look and subsequent query...the obvious truth can't be hidden.

Peggy said...

As a science and social studies teacher of fourth graders, it appeared as if I was not doing my job because those scores were lower than ELA and math. This also caused the effectiveness ratings of science and social studies teachers to be lowered.

Stephanie Usey said...

Please post the percentages of mastery and advanced when you get them please.

Jeremy said...

It's all a numbers game. Data is easily manipulated to show whatever results are desired. We know and White knows this. The public doesn't realize this. As long as the whistle is not blown loudly enough, it will not matter to the public. Oh, the students are doing just as well or slightly better on a harder test? Awesome. Nevermind the awful levels of data manipulation. Sickening.

Anonymous said...

So....is this, common core, what a group of teachers is suing to keep??? Maybe Jindal got something right!

Anonymous said...

It would be very interesting to see EOC score percentages, especially Algebra and Geometry. The tests were much more difficult but the scores did not change much.

Anonymous said...

So, since 8th grade core teachers student's LEAP scores are part of the horrible mess used to evaluate us, math and ELA teachers get a higher score and thus better overall evaluations than the science and social studies teachers all because the scores are manipulated to make it look like students math and ela scores are rising under common core ???? So since for years this state could care less about science and social studies in middle school, this Compass mess is including inflated scores?

Anonymous said...

The only way to truly know how much our kids are learning is to take away the high stakes part of the test. Then teachers won't have to teach to the test, kids will relax when taking the test, and only then will we get a true idea of how out kids are doing. Isn't that why we test them in the first place?

otr214426 said...

sad

otr214426 said...

VIRUS REMOVAL

Is Your Computer Sluggish or Plagued With a Virus? – If So you Need Online Tech Repairs
As a leader in online computer repair, Online Tech Repairs Inc has the experience to deliver professional system optimization and virus removal.Headquartered in Great Neck, New York our certified technicians have been providing online computer repair and virus removal for customers around the world since 2004.
Our three step system is easy to use; and provides you a safe, unobtrusive, and cost effective alternative to your computer service needs. By using state-of-the-art technology our computer experts can diagnose, and repair your computer system through the internet, no matter where you are.
Our technician will guide you through the installation of Online Tech Repair Inc secure software. This software allows your dedicated computer expert to see and operate your computer just as if he was in the room with you. That means you don't have to unplug everything and bring it to our shop, or have a stranger tramping through your home.
From our remote location the Online Tech Repairs.com expert can handle any computer issue you want addressed, like:
• - System Optimization
• - How it works Software Installations or Upgrades
• - How it works Virus Removal
• - How it works Home Network Set-ups
Just to name a few.
If you are unsure of what the problem may be, that is okay. We can run a complete diagnostic on your system and fix the problems we encounter. When we are done our software is removed; leaving you with a safe, secure and properly functioning system. The whole process usually takes less than an hour. You probably couldn't even get your computer to your local repair shop that fast!
Call us now for a FREE COMPUTER DIAGONISTIC using DISCOUNT CODE (otr214426@gmail.com) on +1-914-613-3786 or chat with us on www.onlinetechrepairs.com.






otr214426 said...

Problem: HP Printer not connecting to my laptop.

I had an issue while connecting my 2 year old HP printer to my brother's laptop that I had borrowed for starting my own business. I used a quick google search to fix the problem but that did not help me.

I then decided to get professional help to solve my problem. After having received many quotations from various companies, i decided to go ahead with Online Tech Repair (www.onlinetechrepairs.com).

Reasons I chose them over the others:
1) They were extremely friendly and patient with me during my initial discussions and responded promptly to my request.
2) Their prices were extremely reasonable.
3) They were ready and willing to walk me through the entire process step by step and were on call with me till i got it fixed.

How did they do it
1) They first asked me to state my problem clearly and asked me a few questions. This was done to detect any physical connectivity issues with the printer.
2) After having answered this, they confirmed that the printer and the laptop were functioning correctly.
3) They then, asked me if they could access my laptop remotely to troubleshoot the problem and fix it. I agreed.
4) One of the tech support executives accessed my laptop and started troubleshooting.
5) I sat back and watched as the tech support executive was navigating my laptop to spot the issue. The issue was fixed.
6) I was told that it was due to an older version of the driver that had been installed.

My Experience
I loved the entire friendly conversation that took place with them. They understood my needs clearly and acted upon the solution immediately. Being a technical noob, i sometimes find it difficult to communicate with tech support teams. It was a very different experience with the guys at Online Tech Repairs. You can check out their website www.onlinetechrepairs.com or call them on 1-914-613-3786.
Would definitely recommend this service to anyone who needs help fixing their computers.
Thanks a ton guys. Great Job....!!

cardiology fellowship personal statement sample said...

Manipulated prospects will either have almost brought around all those values which by the time and meaning considered to be so essential.