this post was submitted on 29 Aug 2023
155 points (100.0% liked)
Technology
37742 readers
67 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
In theory yes... but what do we call "doing a better job"? Is it just blindly extracting money? Or is it something more, and do we all agree on what it is? I think there could be a compounded problem of oversight.
Like, right now an employee pays/invests some money into a retirement fund, whose managers invest into several mutual funds, whose managers invest into several companies, whose owners ask for some performance from their C-suite, who through a chain of command tell the same employee what to do. Even though it's part of the employee's capital that's controlling that company, if it takes an action negative for the employee like fracking under their home, or firing them, they're powerless to do anything about it with their investment.
With AI replacing all those steps, it would all happen much quicker, and —since AIs are still basically a black box— with even less transparency than having corruptible humans on the same steps (at least we kind of know what tends to corrupt humans). Adding strict "code as contract" rules to try to keep them in check, would on a first sight look like an improvement, but in practice any unpredicted behavior could spread blindingly fast over the whole ecosystem, with nobody having a "stop" button anymore. That's even before considering coding errors and malicious actors.
I guess a possible solution would be requiring every AI to have an external stop trigger, that a judicial system could launch to... possibly paralyze the whole economy. But that would require new legislation to be passed (with AI lawyers), and it would likely get late, and not be fully implemented by those trying to outsmart the system. Replace the judges by AIs too, politicians with AIs, talking heads on TV with AIs... and it becomes an AI world where humans have little to nothing to say. Are humans even of any use, in such a world?
None of those AIs need to be an AGI, so we could run ourselves into a corner with nobody and nothing having a global plan or oversight. Kind of like right now, but worse for the people.
Alternatively, all those AIs could be eco-friendly humans-first compassionate black boxes... but I kind of doubt those are the kind of AIs that current businesses are trying to build.
Thing is nobody will do that because once AI finds a way to spazz out that is totally unpredictable (black box) everything might just be gone.
It's a totally unrealistic scenario.
They are working on mitigating the unpredictable "black box".
Like making the AI explain their working method step by step. Not only does it make the AI more transparent, it also increases the correctness of whatever it types.
AI is still in development. It is good to list the problems you have, but don't think those problems won't be solved in the future.
People are already doing it, piece by piece, in all areas. As more AIs get input from other AIs, the chance of a cascading failure increases... but it will seem to be working "good enough" up until then, so more people will keep jumping on the bandwagon.
The question is: can we prepare for the eventual cascading spazz out, or have we no option other than letting it catch us by surprise?