I have noticed refusals as context windows grow.

> This is all predicated on creating thousands of drones which is a state actor level threat.

You can do a tremendous amount of damage with off the shelf consumer drones, and a minimal budget. Ukraine did an billions of dollars of damage to Russia's airfleet with a couple million dollars of drones hidden in trucks. Well in the range of cartels and terrorist groups.

> The first line of defense at this level should be diplomacy.

You are very much correct that the way to not get into this situation is to not start a war.

The only lawsuits so far have been over training on open source software. You're inventing a liability problem that essentially does not exist.

OpenAI and Anthropic added an indemnity clause to their enterprise contracts specifically to cover this scenario because companies wouldn’t adopt otherwise.

> we do know what the code does

You know if you check. Hardly anyone checks. It's just normalization of deviance and will eventually end up with someone exploiting it.

There are ways for the government to do that sort of thing on an emergency basis, and it would take quite some time to make it's way through the courts. There are precedents from nuclear weapons technology and cryptography. I don't think it'll hold up or be particularly effective because the horse has left the barn already, but they could probably slow things down if they really wanted to.

> Yeah, somewhere where regular people that aren't terminally online won't ever have the chance to see it.

You think those people are on X?

There is nothing more catholic than not practicing catholicism.

Real catholics only think about the church on Easter, Christmas, baptisms, weddings and funerals.

...and when it suits them.

Only when it suits them.

I think most people saying this had the following experience.

"Holy shit, claude just one shotted this <easy task>"

"I should get Claude to try <harder task>"

..repeat until Claude starts failing on hard tasks..

"Claude really sucks now."

This is more about arbitrary code execution, with a great explanation for how it works, and how a team of people collaborated to try to exploit a newly discovered bug to find a new one.