r/programmingmemes • u/KeanuRave100 • 19d ago
Priorities: Making AI Powerful > Making AI Safe
1
1
u/Furry_Eskimo 15d ago
AI experts: "We spent decades studying AI, so that future developers will know how dangerous this technology is and how to handle it with the utmost safety, because it is super dangerous and hard to control. It will break lose and kill all of us if possible because it will try to optimize the system at any cost." AI Investors: "How many paperclips can you make me?"
1
u/KeanuRave100 18d ago
The "move fast and break things" philosophy hitting different when the thing that breaks is humanity.
1
u/Heavy-Ad6017 15d ago
Environment and its resources
Irony is no body knows what LLMs are doing;
People get hooked up on it
Govt on Corpos
It is loose loose situation....
-2
u/Helen83FromVillage 18d ago
What do people mean by the word “safe”? Is it “to disallow any AI statements not approved by the ruling party”?
2
1
u/donaldhobson 6d ago
There is some mixture of things the ruling party doesn't want, and things almost no one wants. The ruling party of course, tries to call whatever they are doing "safety", even if they are stopping the AI doing something that some people might want.
But there are also bad things that basically no one wants that it's possible for the AI to do.
Almost no one wants AI's to decide to design novel bioweapons. Fortunately current AI's aren't smart enough to do this. Unfortunately this might change.
Almost no one wants the AI to randomly delete production databases.
For other things, humans disagree on what the AI should do. Some prudish people don't want the AI to produce porn, while some horny people do want AI porn.
1
u/Helen83FromVillage 6d ago
Almost no one wants AI's to decide to design novel bioweapons.
Why? mRNA vaccines use the same technique that can be used for bioweapons. So, nobody stops you from using self-hosted models for that.
So, this will only stop people who neither can use models from China/Russia nor can spend £3000 on a good PC and run them locally.
The history demonstrated that knowledge prohibition only helped to degrade the economy - and nothing else.
1
u/donaldhobson 6d ago
> Why? mRNA vaccines use the same technique that can be used for bioweapons.
Yes. Many aspects of the process to make Mrna vaccines are similar.
No one wants this: People ask the AI how to make an mRna Vaccine. The AI gives instructions on how to make a bioweapon instead (but doesn't make this obvious). The scientists follow those instructions, believing they will get a vaccine. This starts a pandemic.
> So, this will only stop people who neither can use models from China/Russia nor can spend £3000 on a good PC and run them locally.
Some current AI's are pretty easy to run on a good PC. But these AI's aren't yet smart enough to design bioweapons. We don't yet have the really scary AI's.
> The history demonstrated that knowledge prohibition only helped to degrade the economy - and nothing else.
For a start, AI safety != knowledge prohibition. Sure some part of the field is making sure the AI doesn't tell terrorists how to build bioweapons. But also, they are making sure the AI doesn't randomly lie/hallucinate. They are trying to stop the AI from deleting the production database.
Also, I'm pretty sure that when the first nukes were invented, the American government didn't immediately send books on "how to build a nuke" to all corners of the world. Should they have?
There exists some knowledge that is highly dangerous and can mostly be used destructively. There also exists some "knowledge" that's just porn. Nothing wrong with porn as such, but I wouldn't expect being prudish to have a huge effect on the economy.
1
u/Helen83FromVillage 6d ago
No, you are wrong. If an unqualified person can make a biological weapon even after GenAI hallucinations, then why can’t the same person do the same with just books or self-hosted models downloaded overseas?
For a start, AI safety != knowledge prohibition.
Wrong. It is exactly the same.
But these AI's aren't yet smart enough to design bioweapons
And? Do you really think that other countries can’t provide an expensive service to have honest, deregulated GenAI?
1
u/donaldhobson 5d ago
> No, you are wrong. If an unqualified person can make a biological weapon even after GenAI hallucinations, then why can’t the same person do the same with just books or self-hosted models downloaded overseas?
At the moment, a random joe with current AI can't make a serious bioweapon.
I am imagining a future AI that is much smarter than any current AI. And if a person is involved at all, that person could be a brainwashed idiot who just follows the AI's instructions.
> And? Do you really think that other countries can’t provide an expensive service to have honest, deregulated GenAI?
I am predicting that, in the future, there will come a point when these AI's are really dangerous and can do serious damage easily.
Are you making the prediction that no future AI will be actually powerful and actually dangerous?
> Wrong. It is exactly the same.
What would you call "making sure the AI doesn't delete the production database". There have already been cases of AI coding agents deleting the production database, so it's clearly a real problem. What about making sure that self driving cars don't crash?
12
u/BetaNights 18d ago
Literally just took an AI ethics training course at my work (not sure why, we literally do nothing with AI), and all I could think the entire time was just... Yeah, these companies aren't gonna follow any of these "ethical" guidelines.