A thread through the archive
Essays tagged “GPT models”. Follow an idea across the archive.
Scott tests OpenAI's o3 model's ability to identify locations from photos, finding it has remarkable success even with minimal visual information, raising questions about AI capabilities.
Scott Alexander analyzes the astronomical costs and resources needed for future AI models, sparked by Sam Altman's reported $7 trillion fundraising goal.
The post explores AI forecasting capabilities, compares prediction market performances, and provides updates on various ongoing predictions in technology and politics.
Scott Alexander examines Redwood Research's attempt to create an AI that avoids generating violent content, using Alex Rider fanfiction as training data.
Scott Alexander argues against Gary Marcus's critique of AI scaling, discussing the potential for future AI capabilities and the nature of human intelligence.
Scott Alexander bets that AI models will quickly overcome current limitations, based on how GPT-3 improved on GPT-2's shortcomings identified by Gary Marcus.