Technology

38398 readers

37 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 3 years ago

MODERATORS

TheRtRevKaiser@kbin.social

190

Brian Eno: “The biggest problem about AI is not intrinsic to AI. It’s to do with the fact that it’s owned by the same few people” (musictech.com)

submitted 5 days ago by misk@sopuli.xyz to c/technology

31 comments fedilink hide all child comments

The biggest problem about AI is not intrinsic to AI. It’s to do with the fact that it’s owned by the same few people, and I have less and less interest in what those people think, and more and more criticisms of what the effect of their work has been.

you are viewing a single comment's thread
view the rest of the comments

[–] teawrecks@sopuli.xyz 2 points 5 days ago (1 children)

If you are familiar with the concept of an NP-complete problem, the weights are just one possible solution.

The Traveling Salesman Problem is probably the easiest analogy to make. It's as though we're all trying to find the shortest path through a bunch of points (ex. towns), and when someone says "here is a path that I think is pretty good", that is analogous to sharing network weighs for an AI. We can then all openly test that solution against other solutions and determine which is "best".

What they aren't telling you is whether people traveling that path somehow benefits them (maybe they own all the gas stations on that path. Or maybe they've hired highway men to rob people on that path). And figuring out if that's the case in a hyper-dimensional space is non-trivial.

[–] thejevans@lemmy.ml 6 points 5 days ago (1 children)

uh sure. My point is that sharing weights is analogous to sharing a compiled binary, not source code.

[–] teawrecks@sopuli.xyz 2 points 5 days ago

Yes, and I don't like the common comparison to binary blobs, and I'm attempting to explain why.

It is inherently safer to blindly run weights than it is to blindly execute a binary. The issues only arrise if you are then blindly trusting the outputs from the AI. But you should already have something in place to sanitize outputs and limit permissions, even for the most trustworthy weights.

It's basically like hiring someone and wondering if they're Hydra; no matter how deep your background check is, they could always decide to spontaneously defect and try to sabotage you. But that won't matter if their decisions are always checked against enough other non-Hydra employees.