this post was submitted on 07 Jul 2024
73 points (100.0% liked)

TechTakes

42 readers
16 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Zos_Kia@lemmynsfw.com 2 points 4 months ago (6 children)

I've been experimenting on creative writing tools with a bunch of writer friends, and the setup described in this paper is notoriously shit. I mean they come up to ChatGPT on v3.5 (or Bard lmao) and expect it to write comedy ? Jeez talk about setting yourself up for failure. That's like walking up to a junior screenwriter and yelling "GIVE ME A JOKE" to them. I don't understand why people keep repeating that mistake, they design experiments where they expect the model to be the source of creativity but that's just stupid.

If you want to get output that is not entirely mediocre, you need something like a Dramatron architecture where you decouple various task (fleshing out characters, outlining at the episode level, outlining at the scene level, writing dialogues etc...) and maintain internal memory of what is being worked on. It is non-trivial to setup but it gets there sometimes - even the authors of this paper recognize that this would have probably produced better results. You also need a user able to provide good ideas that the model can work with, you can't expect the good creative stuff to come from the robot.

Instinctively i'd say you have to treat the model like your own junior writer, and how do you make a junior writer useful ? By teaching them to "yes, and" in a writing room with better writers (in this case, the user). In that context, with a good experienced user at the helm, it can definitely bring value. Nothing groundbreaking but i can see how a refined version of this could help, notably with consistency, story beats, pacing, the boring stuff. GPTs are better critics than they are writers anyway.

That being said i never really pursued "pure comedy" on LLMs as it sounds like a lost battle. In my mind it's kind of like tickling : if a machine pokes your ribs you don't get the tickles, that only works when a human does it. I doubt they can fix that in the short or mid term.

[–] self@awful.systems 14 points 4 months ago

I want to point out that this interminable motherfucker introduced themselves as someone who supposedly does creative writing

[–] o7___o7@awful.systems 14 points 4 months ago (1 children)

That's a lot of words to say, "You're holding it wrong."

[–] Zos_Kia@lemmynsfw.com 2 points 4 months ago

More like "you're trying to paint with a hammer AND you're holding it wrong"

[–] Architeuthis@awful.systems 14 points 4 months ago (2 children)

I like how you lose faith in your argument the longer your post goes on. Maybe start with the last sentence next time.

[–] froztbyte@awful.systems 12 points 4 months ago (1 children)

comment history also includes simulation hypothesis and some very eagleflavoured political analysis

I have a prediction!

[–] Zos_Kia@lemmynsfw.com 2 points 4 months ago (1 children)
[–] swlabr@awful.systems 13 points 4 months ago (2 children)

you would think someone who experiments with creative writing "tools" might understand imagery, but when those "tools" are in fact just 3 GPTs in a trenchcoat, it's not surprising when they don't

[–] froztbyte@awful.systems 9 points 4 months ago

look, maybe the old adage "takes one to know one" could be disproven by this lack of recognition of tools. there might be a paper here!

[–] Zos_Kia@lemmynsfw.com 2 points 4 months ago

I legit don't get it. Is it about the US ? I mostly speak about France in my political comments so i'm not sure where they are going with that.

[–] Zos_Kia@lemmynsfw.com 1 points 4 months ago* (last edited 4 months ago) (1 children)

No i'm saying comedy (as in writing your jokes for you) is not something you should expect from language models. As a general rule, there is no tool that will make you a good writer, only (potentially) tools that can help you do more with your qualities as a writer. But it will never be funnier or more talented than you are.

That's why i personally experiment with writing tools. Writing standup is one thing, but imagine you're writing a sitcom or any form of serialized work. That's a lot of fucking work and obviously if you're starting out you can't exactly afford to pay for assistant writers to do the menial labour that comes with it. Language models can come in handy in that scenario, but again you can't expect them to be the genius in the room if you want a good show you have to bring the good ideas and the funnies. It's a power tool and power tools don't draw the plans for the house they just grind where you need grinding.

[–] gnomicutterance@awful.systems 12 points 4 months ago* (last edited 4 months ago)

That’s a lot of fucking work and obviously if you’re starting out you can’t exactly afford to pay for assistant writers to do the menial labour that comes with it.

Give this promptfucker the props they deserve: usually they don’t just come out and say it.

[–] swlabr@awful.systems 14 points 4 months ago (1 children)

I don't understand why you're getting downvoted. You should read the room, delete your posts, and leave forever. Then you wouldn't be getting downvoted.

[–] Zos_Kia@lemmynsfw.com 2 points 4 months ago (1 children)

Am i getting downvoted ? It says 3 upvotes / 0 downvotes on my end.

[–] gerikson@awful.systems 11 points 4 months ago (1 children)

Here, have another invisible downvote.

[–] froztbyte@awful.systems 10 points 4 months ago (1 children)

it had such strong "well all the people in my town don't seem to have a problem with me" energy

(I can see it happening if they ignore offsite downvotes on that lemmy, but yeah)

[–] acausal_masochist@awful.systems 10 points 4 months ago

Idk if downvotes don't federate at all or if it's homegrown jank, but I've never seen a downvote on another instance's post.

[–] bitofhope@awful.systems 13 points 4 months ago (1 children)

I mean they come up to ChatGPT on v3.5 (or Bard lmao) and expect it to write comedy?

Yeah, these things are supposed to be good at writing, aren't they?

[–] Zos_Kia@lemmynsfw.com 1 points 4 months ago (1 children)

Define "good at writing". Good comedy is very difficult to attain and none of the models are anywhere near it, including the more recent ones.

[–] bitofhope@awful.systems 15 points 4 months ago (1 children)

Define “good at writing”.

I don't want to.

Good comedy is very difficult to attain and none of the models are anywhere near it, including the more recent ones.

I concur.

[–] Zos_Kia@lemmynsfw.com 1 points 4 months ago (2 children)

a true conversationalist lmao you're doing great buddy

[–] froztbyte@awful.systems 13 points 4 months ago (1 children)

oh, you were looking for the lmao conversations room? you missed the turn: it’s the last door inside clown school. you’re not even in the right building atm!

[–] Zos_Kia@lemmynsfw.com 1 points 4 months ago (2 children)

hey you're the creepy guy who reads comment history before replying to a conversation aren't you ?

[–] bitofhope@awful.systems 12 points 4 months ago (1 children)

I thought the point of posting your ideas on a public forum was to have people read them.

[–] self@awful.systems 14 points 4 months ago (2 children)

nah, there’s nothing creepier than giving some shithead the common courtesy of checking their post history to see if they’re somehow like this all the time or if they’re just having a particularly bad night

gonna be honest, I didn’t give this one that common courtesy cause once they get to the stage where they creepjacket other posters for looking at their previous terrible posts, whatever Reddit has done to their brain is severe and irreversible

[–] dgerard@awful.systems 11 points 4 months ago* (last edited 4 months ago) (1 children)

it's always the ones with a veritable comet tail of receipts

[–] froztbyte@awful.systems 11 points 4 months ago

the esteemed poster huffed and puffed at least twice more on their local, which we blessedly don't have to see

such a hilariously pathetic bit of darvo, too. fuckin dipshits.

[–] froztbyte@awful.systems 10 points 4 months ago

I didn't even press Next Page! dire

[–] froztbyte@awful.systems 10 points 4 months ago (1 children)

this isn't Oprah Ft Holographic Dr Phil, stop projecting

I merely looked after you went 3 for 3 on idiotic posts

[–] Zos_Kia@lemmynsfw.com 1 points 4 months ago (1 children)

oh yeah silly me. That's definitely not creepy 👍

[–] self@awful.systems 10 points 4 months ago

you can’t even sign off on your shitty posts to the degree that you’re now pretending it’s creepy to click a link and take a 5 minute scroll through your bullshit

it’s time for you and your shitty posts to leave

[–] bitofhope@awful.systems 12 points 4 months ago

Dunno what you want me to say. Define the vague concept of "good writing"?

The linked study finds that ChatGPT 3.5 and Bard suck at writing comedy. You claim in so many words that this should be obvious (along with a really dubious claim that machines can't tickle people for some reason). I'm also not surprised that these models are terrible at writing comedy, because even at best of times I find their output bland, trite and crudely stripped of anything potentially divisive.

However, lots of people seem to think that LLMs are good at writing related tasks, so I don't think it's inherently obvious that these tools suck at writing comedy in particular.

All these words make this reply much less fun to write.

[–] V0ldek@awful.systems 12 points 4 months ago

Hey, want some comedy advice? Read the room.