...we’re releasing a new paper, “Measuring Progress Toward AGI: A Cognitive Taxonomy,” that presents a scientific foundation for understanding the cognitive capabilities of AI systems.
Alongside the paper, we are partnering with Kaggle to launch a hackathon, inviting the research community to help build the evaluations needed to put this framework into practice.
Our framework draws on decades of research from psychology, neuroscience and cognitive science to develop a cognitive taxonomy. It identifies 10 key cognitive abilities that we hypothesize will be important for general intelligence in AI systems:
- Perception: extracting and processing sensory information from the environment
- Generation: producing outputs such as text, speech and actions
- Attention: focusing cognitive resources on what matters
- Learning: acquiring new knowledge through experience and instruction
- Memory: storing and retrieving information over time
- Reasoning: drawing valid conclusions through logical inference
- Metacognition: knowledge and monitoring of one's own cognitive processes
- Executive functions: planning, inhibition and cognitive flexibility
- Problem solving: finding effective solutions to domain-specific problems
- Social cognition: processing and interpreting social information and responding appropriately in social situations