TechTakes

I've previously discussed the concept of model collapse, and how feeding synthetic data (training data created by an AI, rather than a human) to an AI model can end up teaching it bad habits, but it seems that DeepSeek succeeded in training its models using generative data, but specifically for subjects (to quote GeekWire's Jon Turow) "...like mathematics where correctness is unambiguous,"

That sound you hear is me pressing F to doubt. Checking the correctness of mathematics written as prose interspersed with equations is, shall we say, not easy to automate.

https://www.wheresyoured.at/deep-impact/ And the companion piece on his blog.

What I didn't wager was that, potentially, nobody was trying. My mistake was — if you can believe this — being too generous to the AI companies, assuming that they didn’t pursue efficiency because they couldn’t, and not because they couldn’t be bothered.

This isn't about China — it's so much fucking easier if we let it be about China — it's about how the American tech industry is incurious, lazy, entitled, directionless and irresponsible. OpenAi and Anthropic are the antithesis of Silicon Valley. They are incumbents, public companies wearing startup suits, unwilling to take on real challenges, more focused on optics and marketing than they are on solving problems, even the problems that they themselves created with their large language models.

This tied into a hypothesis I had about emergent intelligence and awareness, so I probed further, and realized the model was completely unable to ascertain its current temporal context, aside from running a code-based query to see what time it is. Its awareness - entirely prompt-based - was extremely limited and, therefore, would have little to no ability to defend against an attack on that fundamental awareness.

How many times are AI people going to re-learn that LLMs don't have "awareness" or "reasnloning' in a sense humans would find meaningful?

i don't understand the "safety" angle here. if chatgpt can output authoritatively-looking sentence-shaped string about pipebombs, then it's only because similar content about pipebombs is already available on wide open internet. if model is closed, then at worst they would have to monitor its use (not like google blocks any similar information from showing up). if model is open, then no safeguards make sense in the first place. i guess it's more about legal liability for openai? now they can ignore it with all these bills about "ai safety" gone (for now)

Is it a crime to enjoy a succulent Chinese AI?

I know the only intended message there is "I am a big racist", but what kind of dumb fuck adage is "the word is finite, kids are infinite". You're not even trying mother fucker

"The world is finite and kids are infinite, especially African kids." Jfc. Anyway goes to show just how white supremacist the whole "save the children" idea is.

The advanced sinophobia where the Chinese are so much better at everything than the west that even when they make better and cheaper bullshit machines than the Americans do and hand them out for free, it has apocalyptic consequences.

It's wild that Yudkowsky saw a binary choice of "nuclear holocaust" and "superintelligence" and chose "nuclear holocaust" in the first place.

tbh I don't understand this post at all. aella isn't trans so why would she be a target for leopards? I must be misinterpreting

Goddammit why can't the murder cult story just stay morbidly fascinating? Now I've got to worry about implications and how the worst people are gonna use this as ammo.

Ok you brought aella up so now I can post this:

Heard this song for the first time the other day and it reminded me of aella.

side note: what’s a good way to post links to music that isn’t youtube?

i don't think it's the first time i see jessicata acting like a total piece of shit in her completely emotionless way and it's incredibly creepy. she doesn't even seem to be aware of the harm she can cause.