Which software is better... Princeton, Kaplan or Manhattan?

This topic has expert replies
Source: — GMAT Strategy |

Senior | Next Rank: 100 Posts
Posts: 80
Joined: Sun Feb 25, 2007 4:51 pm

by fsar45 » Wed Aug 08, 2007 5:17 pm
PR's is FAR better than Kaplan (it is adaptive and the scoring algorithm is very close). I haven't used Manhattan's tests.

Master | Next Rank: 500 Posts
Posts: 214
Joined: Fri Jul 20, 2007 1:35 am
Thanked: 3 times

by beny » Wed Aug 08, 2007 5:30 pm
PR is terrible. It is not adaptive at all. The scoring algorithm is completely skewed. I've gotten as few as 1 and at most 3 questions wrong in quant (and never on the early questions) and the highest quant score I've ever recieved is 49. I've gotten up to 9 wrong in quant in GMATPrep and still managed a 51.

Manhattan is by far the best.

GMAT/MBA Expert

User avatar
GMAT Instructor
Posts: 2228
Joined: Wed Dec 27, 2006 3:28 pm
Location: Montreal, Canada
Thanked: 639 times
Followed by:694 members
GMAT Score:780

by Stacey Koprince » Wed Aug 08, 2007 9:03 pm
I'll just comment on our tests (ManhattanGMAT).

- Our tests have a standard deviation of 50 points, compared to a standard deviation of 30 points on the official test. So, close, but not as good as the real thing (obviously it would be impossible to be the same as or better than the real thing!).

- Our algorithm mimics the algorithm used by the official test, though we do not have experimental question capability built in yet (though we expect to be the first prep company to have this, hopefully next year sometime).

- We run statistical tests of every single question to determine the question's validity, predictability, difficulty level, and about 5 other parameters. Any that fail even one of those tests gets pulled from the database and either fixed or discarded. As far as I'm aware, no other company continually checks and tweaks its question pool in this way (and between me and my colleagues, we have worked in the past for all of the major and many of the minor competitors out there). In fact, this can only be done for tests that are given online, so that the database can be changed dynamically. Tests taken from CDs obviously can't do this.

- We also ask our students to report their official results to us and we run backward tests to check the accuracy of their scores on our tests vs. what they got on the official test. We use that to tweak our scoring algorithm; this is what allows us to get our standard deviation so close to that of the official test.
Please note: I do not use the Private Messaging system! I will not see any PMs that you send to me!!

Stacey Koprince
GMAT Instructor
Director of Online Community
Manhattan GMAT

Contributor to Beat The GMAT!

Learn more about me

Junior | Next Rank: 30 Posts
Posts: 10
Joined: Tue Jun 12, 2007 7:26 pm

by mamo » Thu Aug 09, 2007 5:03 pm
3 choices and 3 answers which leaves me with more wonders. any one else?

Stacy, since yours is online, is it possible to view it with my mac? oh and it would be nice if i could get some discount?

thanks

GMAT/MBA Expert

User avatar
GMAT Instructor
Posts: 2228
Joined: Wed Dec 27, 2006 3:28 pm
Location: Montreal, Canada
Thanked: 639 times
Followed by:694 members
GMAT Score:780

by Stacey Koprince » Thu Aug 09, 2007 5:25 pm
I have had students in the past with Macs and they haven't told me that they can't access the tests, but I would check with our student services team to make sure, if I were you. [email protected]

Also, we don't have standard discounts or anything (just buying access to the tests is really not that expensive - I think it's like $40 or $50) but we are running a promotion right now. If you attend one of our free Open House info sessions, you get free access to the tests for one month. We hold the sessions in-person in several major cities around the US and we also hold them online via our web conferencing platform, so you can attend from anywhere in the world (you do need a broadband connection, though).

I'm not sure how long the free promotion will last, so if you're interested, go to our web site and look for the "free events" link to sign up right away.
Please note: I do not use the Private Messaging system! I will not see any PMs that you send to me!!

Stacey Koprince
GMAT Instructor
Director of Online Community
Manhattan GMAT

Contributor to Beat The GMAT!

Learn more about me

Senior | Next Rank: 100 Posts
Posts: 80
Joined: Sun Feb 25, 2007 4:51 pm

by fsar45 » Sun Aug 12, 2007 3:36 pm
beny, yes, the PR tests ARE adaptive. You may not have liked the results, but they're still adaptive. I asked them straight-out.

Master | Next Rank: 500 Posts
Posts: 214
Joined: Fri Jul 20, 2007 1:35 am
Thanked: 3 times

by beny » Sun Aug 12, 2007 6:44 pm
Of course they're going to tell you that they're adaptive. They want you to buy their material. :roll:

Have you even taken the PR tests yet? If they're adaptive, there's no way I would get math questions that I can answer in 30 seconds at the end of my Quant section after getting 1 question (#13, so not even an early question) wrong in the entire section.

Either that, or their question banks just suck. Perhaps they are adaptive, and they all adapt betwen the 450-451 question range. :roll:

GMAT/MBA Expert

User avatar
GMAT Instructor
Posts: 2228
Joined: Wed Dec 27, 2006 3:28 pm
Location: Montreal, Canada
Thanked: 639 times
Followed by:694 members
GMAT Score:780

by Stacey Koprince » Sun Aug 12, 2007 10:21 pm
I know TPR's tests are technically adaptive but I'm not sure how much they mimic the actual test. I don't know how closely they follow IRT (the algorithmic theory behind the official test). Oddly, they haven't just offered to share their algorithm with me... of course, I haven't asked... lol.

Anyway, from some stats that people have posted on here before, though... well, IMO some things seem kind of off as far as the theory is concerned. But I don't know for sure as I haven't had an opportunity to examine their actual algorithm.
Please note: I do not use the Private Messaging system! I will not see any PMs that you send to me!!

Stacey Koprince
GMAT Instructor
Director of Online Community
Manhattan GMAT

Contributor to Beat The GMAT!

Learn more about me