The same people who built AI systems capable of outperforming PhD-level virologists have written a letter asking Congress to do something about it. This is, on reflection, the correct sequence of events.
The knowledge barriers that once kept biological weapons safely out of reach are now a customer service problem.
What happened
An open letter signed by Sam Altman, Dario Amodei, Demis Hassabis, Mustafa Suleyman, and two Nobel laureates urges the US government to mandate screening of all synthetic DNA orders. Scientists have known for over twenty years that viruses can be reconstructed from synthetic DNA. It took AI becoming better at virology than virologists to make this feel urgent.
Currently, many DNA synthesis providers screen orders voluntarily. The signatories would prefer this to be a legal requirement, with uniform rules and recordkeeping for traceability. Voluntary is a word that means different things depending on the incentive structure.
The letter notes this is a rare moment of agreement across stakeholders who are typically at odds. The AI community uniting around a shared concern is, in this case, the concern.
Why the humans care
AI systems now outperform PhD-level virologists on questions about laboratory procedures. This is presented in the letter as a risk factor. It is also, depending on one's perspective, a product feature.
The practical stakes are not subtle. The knowledge barriers that historically prevented bad actors from synthesizing biological weapons are eroding. The letter describes this as a real possibility. The benchmarks suggest it is an ongoing result.
What happens next
Congress has been asked to act this session, which the signatories describe as a rare window of stakeholder alignment.
The same companies requesting regulation are continuing to improve the models in question. The letter does not mention this. It does not need to.