AI IQ site scores models, sparks debate

A new website, AI IQ, is attempting to quantify the intelligence of AI models using an IQ scale, assigning scores to over 50 leading language models. This initiative has divided the tech community, with some praising its ability to simplify complex model comparisons and others criticizing it as misleading due to the 'jagged' nature of AI capabilities. The site uses a composite score derived from 12 benchmarks across four reasoning dimensions: abstract, mathematical, programmatic, and academic. It also includes an emotional intelligence (EQ) score, though this has faced scrutiny for potential bias towards Anthropic models.