GMAT Test-taking population (scaled score average)

This topic has expert replies
Master | Next Rank: 500 Posts
Posts: 203
Joined: Wed Jun 04, 2008 1:01 am
Location: Windsor
Thanked: 5 times
GMAT Score:650
Hi guys,

Am new here - hope you're all well! I have a question regarding the GMAT score. Based on Kaplan stats, I believe the average median GMAT score is 540 although the test was originally designed to have a median of 500. I was told (by Kaplan) that the score has crept up from the original median to 540 due to test prep and greater awareness.

I know the test compares the test taker to the test taking population. However, can anyone tell me how this "test-taking population" is defined? Is it a bell curve for the people taking the test this year or may be an average of the past 5 years? Does anyone know?

Thanks!

GMAT/MBA Expert

User avatar
GMAT Instructor
Posts: 2621
Joined: Mon Jun 02, 2008 3:17 am
Location: Montreal
Thanked: 1090 times
Followed by:355 members
GMAT Score:780

by Ian Stewart » Wed Jun 04, 2008 6:04 am
It sounds like a simple question, but I think the answer is a bit complicated. When you take your GMAT, you aren't directly compared against other GMAT test-takers at all; you're compared against GMAT questions, which in turn have been calibrated by earlier test-takers.

As I'm sure you're aware, each GMAT test includes several 'diagnostic questions' which do not contribute to your score. They are included so their difficulty can be gauged for future tests. This process is a bit complicated, so I'll simplify a lot:

-if a diagnostic question is not answered well by most test-takers, it might be calibrated as a 90th percentile question, for example;

-if this question is then included as a real GMAT question a year later, and the test-taking population has improved substantially, it may be answered better this time than it was when it was used as a diagnostic. That is, more people than expected will get the benefit of answering this difficult question correctly- the test effectively says to itself "this correct answer gives me some evidence that this test-taker is above the 90th percentile level". This will boost scores, overall, compared to earlier populations;

-the upshot: you're being compared against the population that had your GMAT questions on their test- when your questions were used as diagnostic questions. I don't think there is any published information about how long the interval can be between when a question is used as a diagnostic and when it is used as a real question.

Of course, many test design details are proprietary, and anyone answering this type of question, unless they work as a GMAT test designer, must make some educated guesses, as I've done.

While I find a lot of these details interesting, I don't think the GMAT test-taker gets any advantage from knowing the scoring algorithm and calibration process inside-out. You want to know enough to devise an intelligent pacing strategy, but that's pretty much it.