this post was submitted on 30 Jul 2023
226 points (100.0% liked)
Technology
38096 readers
34 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I don't fully understand how this works, but if they've created a way to replicate his style that doesn't involve using his art in the model, how is it problematic? I understand not wanting models to be trained using his art, but he doesn't have exclusive rights to the art style, and if someone else can replicate it, what's the problem?
This is an honest question, I don't know enough about this topic to make a case for either side.
TL;DR The new method still requires his art.
LoRA is a way to add additional layers to a neural network that effectively allow you to fine tune it's behaviour. Think of it like a "plugin" or a "mod"
LoRas require examples of the thing you are targeting. Lots of people in the SD community build them for particular celebrities or art styles by collecting examples of the that celebrity or whatever from online.
So in this case Greg has asked Stable to remove his artwork which they have done but some third party has created an unofficial LoRA that does use his artwork to mod the functionality back in.
In the traditional world the rights holder would presumably DMCA the plugin but the lines are much blurrier with LoRA models.
Great explanation, thanks!
Do you know how they recreated his style? I couldn’t find such information or frankly have enough understanding to know how.
But if they either use his works directly or works created by another GAI with his name/style in the prompt, my personal feeling is that would still be unethical, especially if they charge money to generate his style of art without compensating him.
Plus, I find that the opt-out mentality really creepy and disrespectful
I still have trouble understanding the distinction between "a human consuming different artists, and replicating the style" vs "software consuming different artists, and replicating the style".
there's no distinction. people are just robophobic.
Generally speaking, the way training works is this:
You put together a folder of pictures, all the same size. It would've been 1024x1024 in this case. Other models have used 768z768 or 512x512. For every picture, you also have a text file with a description.
The training software takes a picture, slices it into squares, generates a square the same size of random noise, then trains on how to change that noise into that square. It associates that training with tokens from the description that went with that picture. And it keeps doing this.
Then later, when someone types a prompt into the software, it tokenizes it, generates more random noise, and uses the denoising methods associated with the tokens you typed in. The pictures in the folder aren't actually kept by it anywhere.
From the side of the person doing the training, it's just put together the pictures and descriptions, set some settings, and let the training software do its work, though.
(No money involved in this one. One person trained it and plopped it on a website where people can download loras for free...)
I don't, but another poster noted that it involves using his art to create the LoRA.
I don't know about creepy and disrespectful, but it does feel like they're saying "I know the artist doesn't want me to do this, but if he doesn't specifically ask me personally to stop, I'm going to do it anyway."
That's really the big thing, not just here but any material that's been used to train on without permission or compensation. The difference is that most of it is so subtle it can't be picked out, but an artist style is obviously a huge parameter since his name was being used to call out those particular training aspects during generations. It's a bit hypocritical to say you aren't stealing someone's work when you stick his actual name in the prompt. It doesn't really matter how many levels the art style has been laundered, it still originated from him.
It is unconditionally impossible to own an artistic style. "Stealing a style" cannot be done.
And yet the artist's name is used to push the weights towards pictures in their style. I don't know what the correct semantics are for it, nor the legalities. That's part of the problem, the tech is ahead of our laws, as is usually the case.
That's not even vaguely new in the world of art.
Imitating style is the core of what art is. It's absolutely unconditionally protected by copyright law. It's not even a .01 out of 10 on the scale of unethical. It's what's supposed to happen.
The law might not cover this yet, but any law that restricts the fundamental right to build off of the ideas of others that are the core of the entirety of human civilization is unadulterated evil. There is no part of that that could possibly be acceptable to own.
I totally agree with you on protecting the basics of creativity and growth. I think the core issue is using "imitate" here. Is that what the LLM is doing, or is that an anthropomorphism of some sense that there's intelligence guiding the process? I know it seems like I'm nitpicking things to further my point, but the fact that this is an issue to many even outside artwork says there is a question here of what is and isn't okay.
The AI is not intelligent. That doesn't matter.
Nothing anyone owns is being copied or redistributed. The creator isn't the tool; it's the person using the tool.
AI needs two things to work, an algorithm and data. If training is allowed to anyone, anyone can create their own algorithms and use the AI as a tool to create innovative new messages with some ideas borrowed from other work.
If data is proprietary, they cannot. But Disney still can. They'll just as successfully flood out all the artists who can't use AI because they don't have a data set, but now they and the two other companies in the world who own IP are basically a monopoly (or tri- or whatever) and everyone else is screwed.
It's only using his name because the person who created the LORA trained it with his name. They could have chosen any other word.
True, and then because it's a black box there wouldn't be a known issue at all. Or maybe it would be much less of an issue because the words might have blended others into the mix, and his style wouldn't be as obvious in the outputs, and/or it would be easier to dismiss. Did the training involve actual input of his name, or was that pulled from the source trained on? How much control was in the training?
Just wait until you can copywrite a style. Guess who will end up owning all the styles.
Spoiler, it's wealthy companies like Disney and Warner. Oh you used cross hatching? Disney owns the style now you theif.
Copyright is fucked. Has been since before the Mickey mouse protection act. Our economic system is fucked. People would rather fight each other and new tools instead of rallying against the actual problem, and it's getting to me.
You're right, copyright won't fix it, copyright will just enable large companies to activate more of their work extract more from the creative space.
But who will benefit the most from AI? The artists seem to be getting screwed right now, and I'm pretty sure that Hasbro and Disney will love to cut costs and lay off artists as soon as this blows over.
Technology is capital, and in a capitalist system, that goes to benefit the holders of that capital. No matter how you cut it, laborers including artists are the ones who will get screwed.
Me, I'll benefit the most. I've been using a locally running instance of the free and open source AI software Stable Diffusion to generate artwork for my D&D campaigns and they've never looked more beautiful!
Same here. It's awesome being able to effectively "commission" art for any random little thing the party might encounter. And sometimes while generating images there'll be surprising details that give me new ideas, too. It's like brainstorming with ChatGPT but in visual form.
Is drawing Mickey Mouse in a new pose copying the style or copying Mickey Mouse?
You said it yourself. You're drawing Micky mouse in a new pose, so you're copying Mickey mouse.
Drawing a cartoon in the style of Mickey mouse isn't the same thing.
You can't have a copyright on "big oversized smile, exaggerated posture, large facial features, oversized feet and hands, rounded contours and a smooth style of motion".
The second.
I'm not sure how that's relevant here, though. There is nothing at all being copied but an aesthetic.
You're pretty spot on. It's not much different from a human artist trying to copy his style by hand but without reproducing the actual drawings.