How Often Does Tracking AI Update Its AI Model Data?

Updated

Tracking AI does not publish a fixed update schedule. Instead, the site reflects a continuous cycle: the AI models it tracks "regularly request and update," and Tracking AI records those changes as they happen. The clearest signal of freshness is the AI Latest Update Times section on the site, plus the dated update banner (for example, "Update: Claude 3.5 Sonnet now added!"). If you need to know whether a specific model's data is current, check those two places rather than assuming a weekly or monthly cadence.

What "updating" actually means here

Tracking AI is a monitoring project that quizzes AI models and publishes their results across several tests. Because the underlying models change their answers over time, the site treats data as something that moves, not something frozen at launch.

Two separate things update:

  • The model roster — new AI models get added to the tracked set. The page evidence shows an update notice for Claude 3.5 Sonnet, which is the kind of change announced in the banner.
  • The scores themselves — IQ/reasoning score, speed (average answer time), and cost per answer are re-measured as models respond differently over time.

The site's own framing supports this: the author notes that "AI models change their answers constantly," which is the stated reason the site exists as an ongoing utility rather than a one-time snapshot.

How to check how fresh the data is

  1. Look at the update banner near the top of the page. It names the most recent addition or change (e.g., a newly added model).
  2. Open the "AI Latest Update Times" section. This is the dedicated place where the site lists when AIs were last updated.
  3. Use the time-window filters on the results view — Last Day, Last Week, and Last Month — to see recent activity rather than the full history.
  4. Read the daily moving average chart, which smooths results over time and makes recent shifts visible.

Expected result: you can tell whether the model you care about has been touched recently, and you can see the direction its scores are moving instead of only a single number.

Why there is no simple "every X days" answer

The update rhythm depends on the models, not on a publishing calendar:

  • Models "regularly request and update," so changes arrive when the models themselves change.
  • Some updates are roster changes (a new model appears), others are score changes (an existing model answers differently).
  • The site separates Offline tests (a Mensa-member-authored quiz never published on the public internet and, per the site, not in any AI training data) from Mensa Norway, a public online IQ test. Results from these can shift for different reasons, so a single update interval would be misleading.

Staying informed without re-checking manually

The site points to a Substack subscription for updates, described as the way to "receive more updates." If you want to know when new models or refreshed scores land, subscribing is the intended channel. Otherwise, the update banner and the AI Latest Update Times section are your on-page indicators.

Practical takeaway

If your question is "is this number current?", don't rely on an assumed schedule. Check the banner, the AI Latest Update Times list, and the Last Day/Week/Month filters. If your question is "when will the next update happen?", the honest answer from the available information is: whenever the tracked models change or a new model is added — with Substack as the way to be notified.