Technology

37706 readers

11 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago

MODERATORS

TheRtRevKaiser@kbin.social

Amouranth made a chatbot clone to outsource flirting — and protect herself (www.polygon.com)

submitted 1 year ago by alyaza to c/technology

32 comments fedilink hide all child comments

there is... a lot going on here--and it's part of a broader trend which is probably not for the better and speaks to some deeper-seated issues we currently have in society. a choice moment from the article here on another influencer doing a similar thing earlier this year, and how that went:

Siragusa isn’t the first influencer to create a voice-prompted AI chatbot using her likeness. The first would be Caryn Marjorie, a 23-year-old Snapchat creator, who has more than 1.8 million followers. CarynAI is trained on a combination of OpenAI’s ChatGPT-4 and some 2,000 hours of her now-deleted YouTube content, according to Fortune. On May 11, when CarynAI launched, Marjorie tweeted that the app would “cure loneliness.” She’d also told Fortune that the AI chatbot was not meant to make sexual advances. But on the day of its release, users commented on the AI’s tendency to bring up sexually explicit content. “The AI was not programmed to do this and has seemed to go rogue,” Marjorie told Insider, adding that her team was “working around the clock to prevent this from happening again.”

you are viewing a single comment's thread
view the rest of the comments

[–] Gaywallet 9 points 1 year ago* (last edited 1 year ago) (1 children)

Eh, all chat bots trained on internet data become horny in the same way that virtually all AI is racist. It's merely a reflection of the data it's trained on, but a lot of people think they can magically control it by putting 'safeguards' after it's been trained. The constant game of cat and mouse with gpt3/4 and prompts to getting it to ignore safeguards are proof this doesn't work.

You can fix this through additional weighted layers and more complex upstream training tweaks, but then you have to pay to retrain which is by far the most expensive part about open AIs model.

[–] a_statistician@programming.dev 1 points 1 year ago (1 children)

You can also curate the training data so that it's not problematic, but then you are biasing the model in other ways.

[–] Gaywallet 1 points 1 year ago

Impossible at scale. Data is always biased, it's a matter of tradeoff