scene graphs
2 ENTRIESA Graph as a Model Harness: Let Context Correct Vision
Part 3 of AI Beyond the Model. Part 2 explains the representation layer. Most discussion of scene graphs asks how to turn visual detections into structured state. I am interested in the reverse direction too: can the structure help correct the detections and associations that produced it? This was the focus of a discussion about retail shelf images. The initial models might detect products and price labels, produce top-k product candidates, and propose which label belongs to which product.
From Next-Token Prediction to Persistent World Models: Notes on the Future of AI
Part 1 of AI Beyond the Model. On September 2 and 3, I had a conversation that began with a practical question: if so many language models seem to share the same architecture, why can one inference engine run so many of them? It ended somewhere less practical and more interesting: perhaps the next step in AI is not one model that directly answers every question about its input, but a system that builds and maintains a model of the world, then lets other components reason over it.