Can You Fix What the Algorithm Thinks About You?
Todd Brooks, Founderupdated October 30, 20268 min read

Jump to a section10
- TL;DR
- What is recommendation algorithm control?
- "What the algorithm thinks about you" is a set of signals
- Level one: stated-preference controls
- Level two: explanation of factors
- Level three: verified representation editing
- What "your picture of me is wrong" means in practice
- Pairs well with: the business on the other side
- Decision Guide
- FAQ
TL;DR
- The question: a feed, a store, or a screening system has built a picture of you, and the picture is wrong. Can you fix it?
- Three kinds of control: stated preferences (you tell the system what you want), explained factors (it tells you what it used), and verified representation editing (someone finds the internal picture, changes it, and proves the change held).
- What exists today: the first two, without any interpretability. The third needs access to a model's internals that no user and almost no business has.
- What to do: use the first two deliberately, ask for a human where the decision is consequential, and keep your own record.
What is recommendation algorithm control?
Recommendation algorithm control is the set of ways a person can change what an automated system decides to show them or decide about them. It comes in three levels. Stated-preference controls change the inputs. Explanations of factors reveal what the system used. Verified representation editing changes the system's internal picture and confirms the change held. Only the third needs interpretability.
Best for: people who want to know what is possible when the picture of them is wrong, and the teams on the other side of the screen who need to show a person was told and can appeal. That second job is what the Automated-Decision Transparency and Disclosure Scorecard grades.
Recommendation algorithm control is the consumer's version of a question this whole series asks: can you change what an AI system has concluded, and can you prove the change took. The October 2026 results covered in the AI safety progress tracker made the question feel newly answerable, because if a lab can find and edit a single concept inside a model, editing the picture it holds of a person sounds like the next step. But two of the three ways to fix the picture already exist, have nothing to do with interpretability, and are underused.
"What the algorithm thinks about you" is a set of signals
A recommender does not hold an opinion of you. It holds a representation: numbers built from what you clicked, how long you stayed, what you skipped, what people who behaved like you went on to do, and whatever the operator fed in from elsewhere. The feed is a prediction from that representation. When the feed is wrong, the inputs are wrong, or the weighing is wrong, or the representation itself is. Each has its own fix, and only the last needs anyone to look inside the model.
Level one: stated-preference controls
These are the controls you can already see. A button that says you are not interested. An unfollow. A setting that switches a feed from ranked to chronological. A form that lets you correct the data a decision was based on. Each changes the inputs, and the picture shifts because the inputs did.
This is real control, and the most underused kind. It is bounded in two ways. It works only as well as the operator built it to work, and a not-interested button that removes one post and leaves the representation untouched is a control in name only. And you are editing blind: you can see whether the feed moved, not whether the picture did.
Some rules for the largest platforms have started to address this level. Which rules exist, whether any of them reaches a given service, and what would satisfy them are questions for counsel. This post describes the control, not a duty.
Level two: explanation of factors
The second level is the system telling you what it used. A line under an ad naming your location and an interest category. A notice with a denied application naming the main reasons. Whether any rule requires that disclosure for a given service is, again, a question for counsel, not for this post.
An explanation of factors tells you which inputs to change at level one. Its limit is one this series keeps running into. The explanation is written by the operator, about the system, usually from design documents, and sometimes generated by a model after the fact. It is not read out of the model. Why an AI's explanation is not proof of its reasoning covers what evidence of a faithful explanation looks like. For a recommender the test is the same: did changing the named factor change the result.
Level three: verified representation editing
The third level is the one the research is about. Instead of changing inputs and hoping, someone with access to the model finds the internal representation, changes it directly, and verifies that the change produced the intended behavior and nothing else.
Pieces of this have been shown in a lab. Anthropic's circuit-tracing work (opens in a new tab) intervened on a model's internal features to make it hallucinate, "quite consistently", that a made-up person plays chess. Goodfire's reward-hacking paper (opens in a new tab) amplified an internal signal while the model wrote a short story about an exam, and the model "wrote stories about cheating". Editing the representation of a person would be the same move, pointed at a different target. Three things stand between that demonstration and a control you could use.
Access. Every one of those interventions required the model's activations. A platform user has no such access, and a business renting a model through an API does not either. Open models, closed APIs, and the right to inspect AI explains who can look inside and who cannot.
Verification. "Verified" is the hard word. An edit that produces the right behavior today and drifts back after the next model update is not a fix. The pillar's status table tracks whether any representation-level intervention has been shown to survive retraining. As of this writing, none has been published that we found.
Direction. A lever that edits the picture toward what you want edits it toward what anyone with access wants. That is the subject of the security risk of editing an AI's behavior, and the reason level-three control, if it arrives, will arrive with permissions and change records attached.
What "your picture of me is wrong" means in practice
- Change the signals on purpose. Use the stated-preference controls as a deliberate act instead of a reflex. If the operator offers a non-profiled mode, try it and note what changes. You are testing whether the control is real.
- Ask for the factors. Where an explanation is offered, read it for the inputs it names, change one, and watch. If the result does not move, the explanation was not the mechanism.
- Where the decision is consequential, ask for a person. A feed ranking is low stakes and often has no appeal path, and the honest answer there is that your leverage is leaving or switching modes. A credit line, a tenancy, an insurance tier, or a benefits determination is different. There the questions are whether you were told an automated system was involved and whether a person with authority to overturn it can review it.
- Keep your own record. What you changed, when, what you were told, and what happened. If you later contest a decision, that record is the only part of the picture you control end to end.
One complication, left open on purpose. Steps one and two assume the operator built honest controls. If the not-interested button is cosmetic, you cannot tell from outside. That is a transparency failure a user cannot fix, which is why the business side of this question matters.
Pairs well with: the business on the other side
If you deploy a system that decides things about people, the consumer's three levels are your three obligations in reverse: offer real controls, explain the factors truthfully, and have a human who can overturn the result. Nothing RedHub sells reads your model. The RedHub standard says a result is based solely on the inputs you supply, with no independent verification of the underlying facts, and the instrument below grades the process around the decision.
The Automated-Decision Transparency and Disclosure Scorecard grades each automated decision system on six transparency and recourse practices drawn from several automated-decision regimes, from your own marks. Its results are DISCLOSED, GAPS, UNDISCLOSED and MATERIAL TRANSPARENCY GAPS. The disclosure control is a gate: if the person was never told an automated system made the decision, the result is forced to UNDISCLOSED regardless of the score, and the gate can only worsen a result, never promote one. Its scope is consequential decisions about a person, such as a credit denial, an insurance tier or a tenant score. It is a readiness aid, not legal advice, and it grades a decision system, never a person.
For what the AI already in use exposes an organization to, GenAI Security Assessment (opens in a new tab) is a free self-assessment you answer yourself. For the research behind level three, start at AI's black box may be opening. For the vendor conversation, the AI inspectability checklist has the ten questions. The running record of what has been shown is the AI safety progress pillar.
Decision Guide
Use levels one and two if: the system is a feed, a store, or anything where the cost of a wrong picture is annoyance.
Escalate to a person if: the decision affects credit, housing, insurance, benefits, or work. Ask whether you were told and whether someone can overturn it.
Do not wait for level three: verified representation editing is a research result, not a consumer control, and nothing in the current evidence puts a date on it.
FAQ
What is recommendation algorithm control?
The set of ways a person can change what an automated system shows them or decides about them. It has three levels: stated-preference controls that change the inputs, explanations of factors that reveal what the system used, and verified representation editing that changes the model's internal picture and confirms the change held. The first two exist today without interpretability.
Can I change what a recommendation algorithm has learned about me?
You can change the inputs it learns from, through not-interested buttons, unfollows, non-profiled modes, and data corrections, and the system's picture shifts because the inputs did. You cannot edit the internal representation directly. That would need access to the model's activations, which platforms do not give users.
Does the law give me control over recommender systems?
This post describes the controls, not any legal requirement. Some rules for the largest platforms address recommender controls. Whether any of them reaches a given service, and what would satisfy it, is a question for counsel. This post states no legal duty.
What is verified representation editing?
Finding the internal representation a model holds, changing it directly, and confirming that the change produced the intended behavior and still holds later. Labs have shown one-off interventions of this kind on concepts inside a model. We have found no published intervention that survives a model update, and no platform offers this as a user control.
What should a business that makes automated decisions about people check first?
Whether the person was told an automated system made or drove the decision, and whether a human with authority to overturn it can review it. The Automated-Decision Transparency and Disclosure Scorecard grades those practices from your own marks and forces UNDISCLOSED when the person was never told. It is a readiness aid, not legal advice, and it does not decide which regimes apply to you.


The gate this post refers to, drawn from the tool’s own logic. See the tool.