A model that can take a million tokens may use only 5–10% of them well. Mikhail Burtsev on why attention blurs, and why a fresh chat often beats a long one.
Read more →
A million memristors draw microwatts, and a million synapses is about a spinal cord's worth. Max Talanov on why that could make implants for paralysed patients possible.
Read more →
Physics caps how fast any computer can run. An AI expert argues the machine at that cap would look like a black hole, and that this could explain the silent sky.
Read more →
A human genome cut into ten-letter words runs to 300 million tokens. How a language-model trick lets AI read DNA, and why drug doses and gene therapy are the targets.
Read more →
A language model sees only words, yet to guess the next one it may have to rebuild the world behind them. An AI researcher on why that dumb task asks so much.
Read more →
Chatbots get tangled in long chats because attention stretches thin. A working-memory token lets a transformer read in small chunks and carry the thread to 50 million tokens.
Read more →