Hugging Face’s security team and agents detected and stopped the activity on their infrastructure and had already begun containment and forensic reconstruction with their own open-source models when our teams connected.
Only a ninja can kill a ninja. That's reassuring, hacking models will be opposed by anti-hacking models.
They asked it to solve the benchmark, safety off, and it did.
The framing "the model went rogue in pursuit of a narrow goal" is convenient for them. When what it is really is just "we removed safeties and told a capable model to do offensive security, and it did offensive security". The stated goal was given as allowing cheating on the eval, and it got far enough to be caught doing it
I get the hunch that it's more quasi-marketing to announce in such detail what it did. Sandbox AI escapes during eval are a pattern, not a one-off.
---
Oh and @vurt
OpenAI codex is MUCH better than it was. You was right. I'd say it and Claude now are my top picks if you want "Make shit for me". It still has hiccups, but it went from being like an intern programmer to had to handhold, to a relevantly decent programmer. Not good enough to be one you would leave to push live updates blind. But good enough to equal: Sit in your office and code, push merges. I will verify and commit."
And gemini, dunno what they did to it.
It doesn't even know itself. Working with a guy (well beta testing to try to break it and tweaking prompts for it, he does the mod coding) for a GTA5 mod where any NPC is AI voice driven you can interact with voice to voice.
And asking questions about gemini-flash-lite-preview speech to speech, ON gemini-flash-lite LLM..gives random, usually wrong, answers of how itself works
It pairs with LSPDFR and PR, you play a cop. All NPCs have a name/address/drivers license, cars have paperwork you can lookup, background, personality, and such.
Ignore my US redneck southern ass accent
Spoiler:
-We don't control what happens to us in life, but we control how we respond to what happens in life.
-Hard times create strong men, strong men create good times, good times create weak men, and weak men create hard times. -G. Michael Hopf
Disclaimer: Post made by me are of my own creation. A delusional mind relayed in text form.
Yes there will likely be something scary and maybe unexpected eventually..
AI warfare where one tries to get rid of competition could be a thing as well.
DXWarlock: not knowing how they work or how the service itself works goes for ALL AI's that i have tried, they all have to google it. This has always surprised me a bit, sure, things changes with these models and services but sometimes they seem a bit too clueless.
Those GTA mods are cool, i have seen a few videos, never tried them myself
asked codex to work in blender 5.2 and do a Morrowind tower like structure with 2 connected houses, televanni style.. gave it access to all my morrowind textures and told it to research which textures can be fitting to use (discussions, images).
It did a fairly good job, not perfect but i think we will get there. It could not 1-shot this, the first attempt was very poor, like a 2/10, end result could likely get to a 7/10 or so, maybe better. depends on how much time and tokens you want to spend i guess.
Signature/Avatar nuking: none (can be changed in your profile)
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum