Knewton CAT Algorithm

This topic has expert replies
User avatar
Master | Next Rank: 500 Posts
Posts: 165
Joined: Thu Feb 17, 2011 5:05 am
Location: San Diego, CA
Thanked: 14 times
Followed by:9 members
GMAT Score:750

Knewton CAT Algorithm

by sunman » Fri Nov 25, 2011 1:20 pm
Alright, so it's only 10 days before my GMAT retake. I decided to brush myself up by taking a free Knewton GMAT CAT. Never tried this brand before, but since I maxed out GMATPrep, MGMAT and 800score, I needed a new CAT to see if my skills have eroded or not (since I'm deploying to Afghanistan soon, predeployment training has been sucking up my study time.)

Came out with a 46Q, 43V and 720 Overall.

Is anyone somewhat familiar with how the algorithm works? (Knewton employees maybe?)

Because I pretty much crushed the Quant, even though I got 3 or 4 wrong in a row...

Anyway, results are below. Kind of upset that I scored in the 73rd percentile on quant again. Just seems to be my nagging critical vulnerability:


Image

Image

Image

Image


Anyway, 10 days to go until (re)game day. Having a hard time getting my quant up to the level that I want. Don't knows how this came out to a 46Q, but it did:
"Never doubt that a small group of thoughtful, committed citizens can change the world. Indeed, it's the only thing that ever has" - Margaret Mead

User avatar
Master | Next Rank: 500 Posts
Posts: 312
Joined: Tue Aug 02, 2011 3:16 pm
Location: New York City
Thanked: 130 times
Followed by:33 members
GMAT Score:780

by gmatboost » Tue Nov 29, 2011 9:54 am
I cannot comment on the first part of your question, but if you're interested in trying to get your quant level up, I can suggest a few resources:

1. GMATBoost.com (Full Disclosure: Please note that this is my site)
2. "Advanced GMAT Quant" book by Manhattan GMAT
3. "Kaplan GMAT 800" book
Greg Michnikov, Founder of GMAT Boost

GMAT Boost offers 250+ challenging GMAT Math practice questions, each with a thorough video explanation, and 100+ GMAT Math video tips, each 90 seconds or less.
It's a total of 20+ hours of expert instruction for an introductory price of just $10.
View sample questions and tips without signing up, or sign up now for full access.


Also, check out the most useful GMAT Math blog on the internet here.

User avatar
Legendary Member
Posts: 588
Joined: Sun Oct 16, 2011 9:42 am
Location: New Delhi, India
Thanked: 130 times
Followed by:9 members
GMAT Score:720

by rijul007 » Tue Nov 29, 2011 10:52 am
Even i have a similar ques regarding the scoring algo that knewton follows..


Image


I just got a few questions wrong somewhere in the middle(Q16-21) and then correctly answered all the remaining questions..
still got just a 46..



@sunman.. i dont think you should worry much.. i am sure you would do pretty well..
All the Best!!

User avatar
Official Company Rep
Posts: 20
Joined: Wed Jul 13, 2011 1:02 pm
Thanked: 2 times

by Jessie@Knewton » Thu Dec 01, 2011 12:25 pm
Hey there,

We get a lot of questions about CAT scores and why they sometimes don't seem to match a student's perceived performance level. This has to do with the way these particular exams are scored; the scoring is much less about how many questions you get right or wrong, but rather which questions you get right and wrong.

The CAT algorithm estimates your ability based on a variety of criteria, including the difficulty of a question. After each question, it evaluates your response and updates this estimate. When the test is over, the algorithm converts your quantitative and verbal ability estimates into the quantitative and verbal scaled scores, and then separately combines your quantitative and verbal ability estimates to calculate the overall score.

Therefore, the number you get correct and incorrect on a CAT is sometimes seemingly incongruous with your scaled scores. Additionally, all CATs have experimental items, and you can get all of those correct or incorrect and they won't change your score, but will alter your perception of what your score should be (since you can't see which ones were experimental). All of this is very much the reason the real GMAT doesn't give you item data -- you just get your scaled scores, so that the confusion of understanding the complicated way in which the CAT works is out of sight of the test-taker.

Hope this clears up the confusion around scoring. Feel free to reach out with any more questions!

All the best,

Jessie
Knewton GMAT Team

User avatar
Master | Next Rank: 500 Posts
Posts: 165
Joined: Thu Feb 17, 2011 5:05 am
Location: San Diego, CA
Thanked: 14 times
Followed by:9 members
GMAT Score:750

by sunman » Thu Dec 01, 2011 7:55 pm
i'm not blasting Knewton or anything, but from what I've seen, it seems like the major test prep companies (Kaplan, Knewton, Princeton Review etc) ask their employees to defend the reputation of their products on these forums.

Really, I'm thankful to Knewton for offering a free CAT so I can brush up on my skills when I have already maxed out on the MGMAT and 800score.com CATs, but that logic is really kind of dubious. I think we both routinely test at the 700+ level, and when we get 31/37 and 33/37 wrong on quant respectively, it's probably a lot more likely that we answered difficult question incorrectly than an easier one.

I don't know. It's whatever. A 720 on a practice exam isn't going to make me shed any tears. I understand what an incredibly onerous process it can be to produce an algorithm that mirrors the official GMAT.

I think Manhattan GMAT probably comes the closest. Overall though, I had a good experience with the Knewton CAT, even if I was surprised by my scaled quant score.

At this point, as long as I am scoring consistent 700+s, I feel pretty good about my retake on Monday.
"Never doubt that a small group of thoughtful, committed citizens can change the world. Indeed, it's the only thing that ever has" - Margaret Mead