this post was submitted on 21 Jun 2023
213 points (100.0% liked)
Technology
37746 readers
50 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
YouTube has a bunch of issues:
1/ climate change:
2/ monetisation:
Going on Peertube could mostly fix every ecological problems for the lost of the uncertainty of the monetisation system.
Plus there is a psychological weigh on creators that goes with the monetisation and algorithm of YouTube.
How would such a system be more efficient? That is very counter intuitive. In addition the question would be who pays for PeerTube. Because unlike Mastodon or Lemmy and the likes, storing large amounts of video files is actually damn expensive.
I'm pretty sure the average successful YouTube content creators can invest in one computer to host his own content on peertube. For start that's all what is needed.
Video storage is a false problem, creators already store their content locally (to not lose the work if there is any issue).
On the technical side, others have answer that question here but in short:
I will need more precise questions for better answers.
My assumption was based on the idea to have a proper YouTube replacement. Not some run down video storage for a hand full of large content creators that can afford it.
A lot of creators delete at least the raw footage because they don't have enough space and it would be too expensive. One creator hosting their own content wouldn't even begin to scale in such a scenario. They would need powerful hardware and serious network connectivity. Something the large creators probably could afford, but most couldn't.
Especially old tech is less efficient than current generations.
tl;dr: I think you were talking about a small solution for large content creators where as I took it as a literal replacement for YouTube.
Smaller servers doesn't mean less work is being done. It means the work is being distributed outside the server farm. Quite likely it is less efficient, not more.
It pretty much definitively is less efficient. Energy costs are a substantial portion of the expense of a data center so efficiency is something they pay very careful attention to.
Less efficient? How?
And I'm pretty sure I didn't say less work was done.
The more you distribute work, the more energy you have to spend on distributing that work.
Scaling things almost always makes things more efficient. Cooling a data center that does the work of a million desktop is going to use less energy to cool it than those million desktops.
I'm pretty sure you got that backwards ... Distributed systems like Lemmy and PeerTube rely on large amounts of redundancy and duplication. In general, centralized systems are going to be more efficient by default. YouTube is an "ecological nightmare" simply because it's absolutely massive. If PeerTube grows to anywhere near the same scale, you can be sure it will far eclipse total energy usage (and also be harder to measure).
I don't see how billions of users connected on the same pipe can be more efficient than being connected each to a different point of a network.
I think YouTube is mostly a network of datacenter of his own right now, but that doesn't change anything since we can not see it.
On the energy usage, maybe, but this usage will be better spread across the earth than being concentrated on a few points.
The Internet is not a "series of tubes" ... It's a packet-switched messaging network. The fact that billions of computers are "connected" to a single address doesn't really mean much other than they've exchanged some messages within the last several minutes (or some other arbitrary amount of time).
You're not wrong: any sizeable web service must distribute to several servers and data centers for performance (e.g. response times and data throughput), and for resiliency (e.g. if a server fails then another one can take over). But the difference is these data centers have a financial incentive to maximize efficiency in both hardware costs and electricity usage (which includes cooling, etc.). Folks self-hosting Lemmy/Mastodon/etc. servers in their basement have much less incentive, and so less effort is put into eeking out every ounce of capability per dollar. Even hosting on AWS/Google/Azure/etc is never going to beat a bespoke data center dedicated to one particular application.
Although they don't necessarily publish this information, at least a data center can accurately measure its energy usage (which tends to dwarf hardware costs...). Also newer hardware will always outperform old hardware per energy usage. For either aspect I can't say the same for the server in my basement ... It's 10 year-old hardware running on the same circuit as the beer fridge next to it. I have no idea how much electricity it uses to handle like 2 users. It's a glorified space heater.
It's all about trade-offs. Fediverse applications value open standardization, availability, and long-term resiliency over efficiency, performance, and short-term profits.
The Fediverse is great, but in the short/mid-term, efficiency and ecological impact aren't things i would expect it to excel at.
There are tubes nonetheless, under the Atlantic ocean for instance.... But I agree.
The major economic impact of the digital is making new teminal. The second is the streaming. I can find the scientific research about that if you like.
With this in mind, you are telling me that a streaming software running with potential low tech hardware and using p2p (allowing for packet to NOT travel 3 times around the world before reaching destination) will not be better for the environment than a centralised video system running 4k formats and advertising everywhere?
Again, maybe I'm missing something here. And yes hardware running uses power, yes datacenter are more power efficient (I already talked about that in the thread).
Low tech ≠ efficient
I have an old laptop that is low tech and uses only 15 watts of power. Compared to that my laptop has a general power usage of 35 watts or more on heavy CPU intensive tasks. On face value it seems that the old machine is more power efficient but that is not the case. The amount computing power provided for that 15 watts used is very low and like 15 times lower than the computational grunt provided by the new machine which makes the new machine 5-6 times more efficient.
Edit - it would great if you can link the scientific papers you mentioned. I am by no means an expert and love to be proven wrong and learn something in the process
Here is the study : https://www.insee.fr/fr/statistiques/4238589?sommaire=4238635 It's in French, I didn't find something in English (maybe in the IPCC studies ). 47% of digital impact comes from users terminals (mostly from smartphone manufacturing).
Yes, but it doesn't mean low tech hardware should always be replace by new ones.
I honestly doesn't understand why everybody here seems to think efficiency=ecology. Mass manufacturing new hardware have a big ecological impact. As I said before things aren't magically replaced by better ones. Old unused tech ends up burning in pile in Africa or Asia.
What's the point of using things like YouTube that keeps promoting 4k (needs for better screen), instant access, streaming over download, advertising, things that have a judge ecological impact.
I understand your points about the ecological impacts of creating and buying new technological devices. But youtube is not the sole driver in making people new devices. People buying new stuff is the goal of the entire tech industry. I dont see how switching to peertube or other FOSS alternatives will lead to an reduction in ecological impact. Hardware companies will still be making new phones, laptops, etc and people will still be buying these new devices.
Dont get me wrong, i would love for FOSS alternatives to youtube becoming mainstream but the ecological impact argument does not seem to hold at least not in my eyes.
The paper was an interesting read though. Thank you. I will try to hold on to devices for longer from now on (hopefully as long as possible)
Google loves making new hardware/tech, but yeah they're not the only one to blame on this...
That is a very fair point. There are ecological costs to electronics manufacturing and waste that are not as well understood as lifecycle energy consumption. It is much more complex and appears much harder to solve than energy consumption ... so maybe that's why.
If you've got some scientific papers handy, I'd love to see them!
The point I'm trying to make is that YouTube has an incentive to design their system to not let traffic travel further than it has to (users closer to a data center hosting the content they want will get it faster). They build data centers close to where their users live. Even then, delivery is likely less energy-intensive than video transcoding, meaning large, specialized data centers make a lot of sense for that task. They then distribute transcoded content to smaller, regional servers to improve user experience ... again, specialized systems for a specialized task.
This means that YouTube has already distributed their system across many different servers in many different regions around the world, so in many ways, they already take advantage of the efficiency benefits of p2p, but they can carefully coordinate to reduce overall costs in a way that p2p can't (yet).
But the Fediverse will lag in efficiency for exactly the reason you pointed out: it's running on low tech, general-purpose hardware. Energy usage has the largest environmental impact by far. Hardware that is specialized (like Application-Specific Integrated Circuits) or newer will always outperform general or old hardware.
Here is the study : https://www.insee.fr/fr/statistiques/4238589?sommaire=4238635 It's in French, I didn't find something in English (maybe in the IPCC studies ). 47% of digital impact comes from users terminals (mostly from smartphone manufacturing).
I agree with you, but YouTube is also a big part of the incentive of building more and more new hardware. Plus as I said before YouTube isn't just for hosting videos but also metrics tools, content id, advertising, editing tools and such... All this needs also power to run.
Did you have any data regarding packet distribution on google services? Last time I checked (about 4/5 years ago) an email send from a gmail to a gmail traveled about 1,5 of the earth size. Which is a lot for 2 laptops side by side in the same room.
Lastly you're trying to make this a debate only on the tech aspect but it is not. They are ethical points at stake and they are equally important I think.
Interesting article (my French is not good, but with the help of translation I get the idea). Thank you for sharing.
Ahh so, I think there is room for confusion. Fediverse is "p2p" only in the context of the (federated) servers. PeerTube/Lemmy/Mastodon/etc. are still "centralized" in that your instance (e.g. programming.dev) is shared with many other users (possibly worldwide). This potentially increases the cost of delivery, because a user still has to find a server, and may select one that is ideologically, rather than physically, close to them. Because YouTube's servers are ideologically homogeneous, there is no reason to find a server other than the one physically closest to you, and thus the cheapest to stream from. So delivery costs to the end user's terminal should be even higher for PeerTube as compared to YouTube!
A completely flat, p2p architecture potentially eliminates almost all of the cost of delivery, but it does introduce other costs, and doesn't eliminate the need for video encoding. I don't have any research available, but I feel confident it will not be simple to compare with centralized services like Fediverse or traditional web services. I will keep my eye out for research.
There are many reasons to switch to Fediverse. I'm simply arguing that "efficiency" is not one of them :)
Unless everyone have an instance near home :) which is the case for me on Peertube, didn't checked for Lemmy though. I should check when I can. But for this to happen we need instances. Small, large, run by people, associations, communities, whatever.
Yes encoding is still a thing, but less analysis, online editing bullshit and advertising. So yeah Peeture is lighter than YouTube ;)
I agree that strict efficiency could be hard to tell on video diffusion only.