What is the algorithm of GMAT

This topic has expert replies
Source: — GMAT Strategy |

User avatar
GMAT Instructor
Posts: 2193
Joined: Mon Feb 22, 2010 6:30 pm
Location: Vermont and Boston, MA
Thanked: 1186 times
Followed by:512 members
GMAT Score:770

by David@VeritasPrep » Fri Nov 22, 2013 5:02 am
The test does not perform in such a simple manner, but in general getting more questions right results in more difficult questions going forward and getting more questions wrong results in less difficult questions. But it does not work in quite the way you have indicated.

This is from Veritas Vice President of Academic Programs Brian Galvin and I think it exactly answers your question.

"Basics of Adaptive Scoring

If your understanding is "get a question right, the next one is harder; get that one wrong, the next question is easier", you're not "wrong", but you're only partially there. That thinking seems to support a percent-correct calculation in a lot of ways: if you get a "Level 5" question right you'd get a Level 6 question next. Get that right and you'd see Level 7, and then if you get the next two wrong you'd be back at Level 5 again. 2 right, 2 wrong in any order, you'd think, would get you to the same place.

But that's not really how it works. Say you did, in fact, get the first "average" question right. At this point the system already has good evidence (albeit one data point's worth) to suggest that you're above average. So its next question is going to try to determine how far above average, not to confirm whether its earlier data point is correct. So if you answer that next question wrong, you don't go back to "average". At this point the system has two data points to evaluate you: one that says "above average" and another that says "but not way, way above average". So the system will likely see you closer to the 70th percentile, not all the way back to the 50th.

We've always been fans of the "Twenty Questions" analogy. If you were playing the road trip game of Twenty Questions and had narrowed the candidate down to "a US president", you might try to determine which era by asking if he was president after 1900. If the answer comes back "yes", then you'll likely want to figure out just how recent he was president, segmenting the remaining 113 years by asking "was he president after 1960? If the answer comes back "no", you wouldn't start thinking back to presidents in the 1860s because your data points already suggest that it's not one of those, so you'll narrow your search even more between 1900 and 1960.

That's in large part what the GMAT scoring algorithm is doing. If its data suggests that you're above average, it's looking to pin in a score in the same way, with this important caveat - it knows that you'll give it bad information from time to time. Sometimes you'll make a silly mistake on a problem you should get right, and sometimes you'll guess right on a question you should get wrong. So the algorithm has to be more flexible than the game of Twenty Questions. And it does so by using probability and statistics."
Veritas Prep | GMAT Instructor

Veritas Prep Reviews
Save $100 off any live Veritas Prep GMAT Course

GMAT/MBA Expert

User avatar
Elite Legendary Member
Posts: 10392
Joined: Sun Jun 23, 2013 6:38 pm
Location: Palo Alto, CA
Thanked: 2867 times
Followed by:511 members
GMAT Score:800

by [email protected] » Fri Nov 22, 2013 4:35 pm
Hi sandeshmishra,

You sound like someone who's taken a few practice CATs and is trying to figure out how the Test adapts to each Test Taker. How have you been scoring so far? What is your score goal?

GMAT assassins aren't born, they're made,
Rich
Contact Rich at [email protected]
Image

GMAT/MBA Expert

User avatar
GMAT Instructor
Posts: 16207
Joined: Mon Dec 08, 2008 6:26 pm
Location: Vancouver, BC
Thanked: 5254 times
Followed by:1268 members
GMAT Score:770

by Brent@GMATPrepNow » Sun Nov 24, 2013 9:08 am
Let me share with you an experiment I performed.

I took GMATPrep Practice Test #1 four times, and each time I answered every odd question correctly and every even question incorrectly (I did this for the quant section only)

Given that I correctly answered exactly half of the questions each time, you'd expect my quant scores to be roughly the same for all 4 tests.

My 4 quant scores were: 19, 23, 26 and 42

This represents a percentile range from approximately 8th percentile to the 54th percentile.

So, as David suggests, the algorithm isn't as straightforward as "answer correctly, get harder question, answer incorrectly, get easier question". However, this is the general idea.

What's important to recognize is that your scores will improve if your quant/verbal (and time-management) skills improve. So, keep working.

Cheers,
Brent
Brent Hanneson - Creator of GMATPrepNow.com
Image