Wednesday 11 March 2009

Slumdog Smarts



Slumdog Millionaire makes a good point about intelligence: the chaiwallah knows a lot of answers, if the questions relate to his life experiences.

This thought sits on a serious problem with IQ testing, or with most standardized tests like the SAT, GRE or CAT. They don't test native intelligence. They test familiarity with a specific way of thinking, which is embedded in culture.

This is the reason why cultural minorities tend to do poorly on standardized tests. A favourite example from this piece by Malcolm Gladwell illustrates this point: Kpelle tribals from Liberia naturally group knives with potatoes, because knives are used to cut potatoes. While this is quite logical, standardized tests generally expect knives to be grouped with other tools, and potates with other root vegetables.

Unfortunately, this unsurprising and well understood limitation of standardized testing has led to horribly complicated racial profiling for university admissions in the USA, and in explicit, even more divisive, quotas in India.

Surely the more creative route is in designing culture-neutral tests? And in validating these instruments sufficiently to bring them into mainstream use?

This blog is idealistic enough to believe that better technology can at least alleviate really knotty political problems.

No comments: