Accuracy of Knewton CATs

This topic has expert replies
User avatar
Senior | Next Rank: 100 Posts
Posts: 31
Joined: Sun Nov 08, 2009 1:15 pm
Location: Indianapolis, IN
Thanked: 8 times
Followed by:2 members
GMAT Score:760

by michaelfaulkner » Sat Jun 18, 2011 5:23 am
IMWATIM wrote:I gave Knewton's daignostic test today and the scores were lower than what I had expected..

Quant 46
Verbal 34

I took GMAT prep #1 couple of months back and scored 700.. after that I worked hard on my quant & verbal ... but the quant score appeared disastrous. I missed 3 questions and scored 46 .. Amazing!!! Also the difficulty level of the questions was pretty much same throughout the Quant section.. the questions never got tougher despite getting most of them right in a row...

Verbal score appears to be skewed as well. Getting 10 questions wrong.. gave me 34.. I got 15 of them wrong in GMAT prep but managed 35... I dont know how to gauge my current preparation level based on this score...

If someone could provide some insights it would be appreciated...

Tnx!!!
Use the official GMAT Prep for a benchmark score. While Knewton won't admit to this, their algorithm is definitely flawed. If you read my post above, the same thing happened to me.

However, because of this, the Knewton CATs will give you a score lower than you'll likely get on test day. For example, I think the highest I got on Knewton was a 710--and on test day I got a 760.

GMAT/MBA Expert

User avatar
GMAT Instructor
Posts: 2623
Joined: Mon Jun 02, 2008 3:17 am
Location: Montreal
Thanked: 1090 times
Followed by:355 members
GMAT Score:780

by Ian Stewart » Thu Jun 23, 2011 3:30 pm
I wouldn't want to comment on the integrity of any individual company's scoring algorithm, so I'm just speaking generally about GMAT-style scoring algorithms. If a test is full of hard questions, you can make several mistakes and still get a good score. If, on the other hand, a test is full of easy questions, you'll need to be nearly perfect to get a good score. So it is certainly possible for a prep company test to use the same scoring algorithm as the real GMAT, but for the scores to be very different between the two tests even with a similar number of wrong answers. For example, in the Quant section of GMATPrep, you can have 7-10 wrong answers and still get a 50 (out of 51), provided your wrong answers are only on the absolute hardest questions. This is possible because GMATPrep contains many true 800-level problems. If, on the other hand, a test was drawing questions from a pool that only contained easy and medium level problems, then it would be impossible with 10 mistakes to get anything close to a 50.

So if a test is producing low Quant scores even when you have only 7 mistakes, it is possible the test is still using the correct scoring algorithm; it may just be that the question pool is far too easy, compared to the real GMAT. The more questions a test contains at a certain level, the more accurate scores tend to be around that level, so tests which contain only easy questions won't produce very accurate scores for high-level test takers, and tests which contain only hard questions won't produce very accurate scores for low-level test takers.
For online GMAT math tutoring, or to buy my higher-level Quant books and problem sets, contact me at ianstewartgmat at gmail.com

ianstewartgmat.com

Master | Next Rank: 500 Posts
Posts: 222
Joined: Mon Oct 13, 2008 4:04 pm
Thanked: 3 times
Followed by:2 members

by venmic » Wed Jul 06, 2011 12:27 am
Did anyone take Knewton test and then the final GMAT test and see the difference in scores can you post it here please
I wrote a knewton diagnostic and I didnt score well at all...

- Verbal Quantitative Total
28 / 47% 33 / 36% 510 / 41%

I generally do way better than this so Im a bit worried

thanks

User avatar
Master | Next Rank: 500 Posts
Posts: 344
Joined: Mon Sep 14, 2009 5:40 am
Thanked: 28 times
Followed by:3 members
GMAT Score:700

by sunnyjohn » Sat Jul 30, 2011 12:56 am
Hi Everyone,

I took the FREE GMAT from Knewton and scored 720.

Verbal: 37 / 80% ( Got 11 wrong )
Quant : 50 / 93% ( Got 4 wrong )

Overall : 720 / 96%

I think its fairly accurate as this is what I am scoring in other tests as well.