Skip to content

AI systems are moving upstream into the layer that filters and structures information before it reaches conscious attention, shaping what becomes thinkable.

System 0 Thinking

AI-mediated relevance

AI systems are moving upstream, shaping what reaches conscious attention.

Riva and co-authors have called this System 0: an AI-mediated layer that shapes information before intuitive or deliberative thought. Riva’s later cognitive-infrastructure work develops the governance concern: AI systems can automate relevance judgement and shift epistemic agency toward non-human systems.

This isn’t a new phenomenon but (agentic) AI adds a deeper dimension. The filtering happens to the problem space itself, not just the solutions.

What gets filtered

An AI agent processes information to achieve a specific goal.

• It selects and organises, and limits what you have access to. • By the time you interact with it, the system has already filtered suggestions and actions to inform what you treat as important.

This could mean a significant loss of epistemic agency, the capacity to decide what counts as relevant.

Once a decision moves into infrastructure, it becomes invisible. This operates at individual, collective, and societal levels.

Testing reliance

To make this visible, Riva proposes infrastructure breakdown methodologies.

• Pick a task where you rely on an AI and remove it. What do you search for? What patterns do you notice? What conclusions do you reach? • Then reintroduce the tool and compare.

Its gaps show where the machine has been deciding for you.

Source:

The case for human-AI interaction as system 0 thinking https://www.nature.com/articles/s41562-024-01995-5 Invisible Architectures of Thought: Toward a New Science of AI as Cognitive Infrastructure https://arxiv.org/abs/2507.22893