this post was submitted on 14 Aug 2023
138 points (100.0% liked)

Technology

1082 readers
19 users here now

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

founded 5 years ago
MODERATORS
top 20 comments
sorted by: hot top controversial new old
[–] harmonea@kbin.social 57 points 1 year ago

Stuart Fergus, the husband of James Bulger’s mother, said that after he reached out to one creator asking them to take down their video, he received a reply saying: “We do not intend to offend anyone. We only do these videos to make sure incidents will never happen again to anyone. Please continue to support and share my page to spread ­awareness.”

He really tried to take down his wife's dead kid's deepfake and got the creator responding "no offense, so like share and subscribe lel"

Using the likeness of another person without that person's express permission should be a jailable offense.

[–] pulaskiwasright@lemmy.ml 40 points 1 year ago* (last edited 1 year ago) (1 children)

This feels so much like a cyberpunk story. It’s so dehumanizing and has such disregard for humanity that it feels like a perfect match for the genre.

I’m really starting to understand how old people get to a point where they no longer want to keep with the times. This is gross.

load more comments (1 replies)
[–] BareHandedPoopScoop@waveform.social 30 points 1 year ago* (last edited 1 year ago)

This is inarguably horrible but the use of AI seems irrelevant. You could make this same thing with any animation tool. It's the idea that's disgusting.

Do you think AI is mentioned because it makes the article seem more up to the minute and in keeping with current tech trends?

"A man drew a disgusting picture of a horrible event using pencils and paper this week."

"Pencils and paper are so awful."

[–] duncesplayed@lemmy.one 29 points 1 year ago* (last edited 1 year ago) (1 children)

Anne Frank advertising baby clothes before discussing the horrors of the Holocaust

Wow, that is amazingly inhumane.

My first thought is they're necessarily making characters who aren't people. A person who has lived through the Holocaust just cannot cheerfully peddle baby clothes. I don't mean that it's physically not possible because she's dead: I mean in terms of the human psyche, a person just flat-out psychologically could not do that. A young boy who succumbed to torture and murder psychology cannot just calmly narrate it.

So obviously, yeah, it's quite a ghoulish and evil thing to take what used to be a person, and a figure who has been studied and mourned because of their personhood, because we can relate to them as a person, and just completely strip them of their personhood and turn them into an inhumane object.

But then that leads to me the question of, who's watching these things, and why? The article says they got quite a lot of views. Is it just for shock value? I don't quite understand.

[–] Pandantic@midwest.social 3 points 1 year ago

Have you met the true crime community? They would eat this stuff up.

[–] OsrsNeedsF2P@lemmy.ml 21 points 1 year ago

“Hello, my name is James Bulger,” says the image in one TikTok video, made in the likeness of the British 2-year-old who was abducted in 1993 as his mother paid for groceries.

“If my mom turned right, I could have been alive today. Unfortunately, she turned left,” the childlike voice says, citing what James’s mother once said was one of her biggest regrets: If she had turned right, she would have seen her son being led away by the two 10-year-olds who later tortured and killed him

Yup

[–] Kara@kbin.social 20 points 1 year ago

The 2 biggest psychopaths join forces, true crime people, and tech bros

[–] donuts@kbin.social 19 points 1 year ago

For fucks sake... AI continues to usher in a new age of human horror.

[–] queermunist@lemmy.ml 17 points 1 year ago

You will never be allowed to die.

🙂

[–] eee@lemm.ee 17 points 1 year ago (1 children)

This is eerily similar to that episode of Black Mirror...

[–] 667@kbin.social 4 points 1 year ago

This is exactly that episode of Black Mirror. The use case is different, but the concept is identical.

[–] jackpot@lemmy.ml 15 points 1 year ago

so fucked up

[–] Roundcat@kbin.social 14 points 1 year ago

This is some radicalizing shit right here.

[–] wama@lemdro.id 14 points 1 year ago

Hey i know this one! Isn't a Black mirror episode?

[–] lemmy@linkopath.com 9 points 1 year ago (1 children)

Reminds me of that Battlestar Galactica spinoff Caprica where the dad recreates his daughters life in a machine by recreating her life from her social media presence...

[–] CmdrShepard@lemmy.one 3 points 1 year ago
[–] autotldr@lemmings.world 9 points 1 year ago (1 children)

This is the best summary I could come up with:


Now, some content creators are using artificial intelligence to recreate the likeness of these deceased or missing children, giving them “voices” to narrate the disturbing details of what happened to them.

TikTok’s guidelines say the advancement of AI “can make it more difficult to distinguish between fact and fiction, carrying both societal and individual risks,” and ask that users who share synthetic or manipulated media showing realistic scenes include a disclaimer noting that the content is not real.

Felix M. Simon, a communication researcher at the Oxford Internet Institute, said he was confident that the videos mentioned in this piece were produced using “one or several AI tools,” but could not say which software exactly.

“They appear to be created with some form of AI tools and bear some of the typical hallmarks of cheaper AI-generated videos,” such as an anime or comic-like aesthetic and polished skin, he said in an email.

Simon cautioned that the videos — which are often accompanied by dramatic or sorrowful music, or show children with scars and bloodied faces — “have the potential to re-traumatize the bereaved.”

Cory Bradford, a TikToker who has gained almost 1 million followers producing history videos, said that while he generally avoids using AI in his own posts, those who do are likely trying to boost engagement, especially on a platform where the audience skews younger.


I'm a bot and I'm open source!

[–] sub_ubi@lemmy.ml 3 points 1 year ago

Admitting you have a problem is the first step to recovery.

[–] AceFuzzLord@lemm.ee 3 points 1 year ago

This just fuels my reasoning for not trusting us with AI. Raising awareness is fine and all, but re-creating a lost child only for them to tell you how they died is beyond fucked up.

[–] linearchaos@kbin.social 3 points 1 year ago

More of that asked if they could not if they should stuff

shivers