Tools

The tools that never look at a photo

Some raters score a questionnaire, not an image; the number is a function of self-report, and it belongs to a different category entirely.

By Updated 4 min readTools

Guides on Tools: Every presentation choice on a result page, and what it does, A taxonomy of rating tools by what they output, A method for judging any rating tool before trusting it

A quiz-style rater scores a questionnaire, not an image: it asks about habits, preferences and self-assessed attributes, then computes a number out of ten from the answers alone. No photo is involved at any point, so the score measures what someone reported, not anything observed.

It belongs to the five kinds of rating tool by output shape, and it belongs nowhere near the other four by what actually produced the number.

What goes in

Multiple-choice answers, sliders, self-rated attributes, sometimes a mix of genuinely factual questions and frankly subjective ones. The tool never receives a photo, never runs a model over pixels, and never observes anything about the person beyond what they typed. Whatever the result page says about "analysis," the only analysis that happened is arithmetic over a set of self-reported inputs.

Why the score is not comparable to an image-based one

A photo-based tool, whatever its other flaws, is scoring an observation - it looked at something and returned a judgement about what it saw. A quiz-style tool is scoring a description someone gave of themselves, filtered through however honestly, generously, or accurately they answered. Two people with identical actual submissions could get very different quiz scores depending on how each one answered the same questions, and two people with identical answers could look nothing alike. Putting a quiz result next to a single-number or multi-axis photo score and reading them as two versions of the same claim is a category error - one measured a description, the other measured an image, and neither result constrains the other.

What it can honestly claim

Internal consistency, and not much beyond it. The same set of answers will reliably produce the same score, which makes a quiz-style tool a stable function of its inputs - useful for comparing two answer sets against each other, in the narrow sense of "if I had answered differently, would the number move." It cannot claim to have observed anything, because it did not; every input came from self-report, and self-report carries its own well-known biases toward flattering answers that a photo-based tool at least does not have to contend with in the same way. Even plain facts drift when people report them: reviewing 64 studies of adults, Connor Gorber and colleagues (2007, Obesity Reviews) found "trends of under-reporting for weight and BMI and over-reporting for height" compared with direct measurement, with "a great deal of individual variability".

Where the line gets blurry

Some tools blend the two: a short questionnaire plus a photo, with both feeding into one final number. The honest reading of a hybrid result is to treat it as two contributions rather than one clean measurement - part observation, part self-report - and to be specific about which part likely moved if the number changes between attempts. A pure quiz-style tool at least has the virtue of being unambiguous about what it is; a hybrid one is more easily mistaken for a fully image-based result because it does include a photo somewhere in its flow. Worth checking on any hybrid: whether the questionnaire portion can move the total on its own, with the photo held constant. If it can, the tool is quietly weighting self-report alongside observation without saying how much, and the split is not something a reader can recover from the final number alone.

Why the format still matters even when the questions seem harmless

A quiz that only asks for age, height or activity level can feel like it is collecting facts rather than opinions, and some of what it collects is factual. But the scoring function that turns those facts into a number out of ten is still a design choice made by whoever built the tool, not a measurement of anything - two quizzes could take identical factual inputs and produce different scores from them, because the weighting between questions is invented rather than derived. That is a smaller version of the same problem a hidden weighting causes in a multi-axis breakdown: an unstated formula sits between the input and the number, and the reader has no way to see it from the result page alone.

What this type is not

It is not a lesser version of an image-based tool, and it is not a shortcut to the same answer. It is a different instrument, measuring a different thing, and the comparison worth making is not "which is more accurate" but "which question is actually being asked" - a quiz measures what someone reports about themselves, and the physical self-report a tape measurement is meant to replace with an actual reading makes the same distinction in the other direction, trading self-report for direct observation of one specific quantity.

Anything closer to genuine self-assessed measurement belongs to that owner, not here, and this page is not the place to work through where quiz answers and actual measurement diverge. What quiz-style scoring does share with the rest of this site's territory is the same discipline about reading a number for what actually produced it - whether that is a model's read of a photo, a person's judgement of a submission, or, here, nothing but a form someone filled in. None of those four inputs are interchangeable, and none of the four resulting numbers, including Rate Cock's own breakdown, should be read as confirming or contradicting a quiz-style score - they were never measuring the same thing to begin with.

Read next

Full archive