this post was submitted on 25 Jul 2024

354 points (100.0% liked)

196

667 readers

38 users here now

Be sure to follow the rule before you head out.

Rule: You must post before you leave.

^other^ ^rules^

founded 1 year ago

MODERATORS

moss@lemmy.blahaj.zone

greembow@lemmy.blahaj.zone

funky_rodent@lemmy.blahaj.zone

PeachyMcPeachface@lemmy.blahaj.zone

remotelove@lemmy.ca

Roflmasterbigpimp@feddit.de

A_Very_Big_Fan@lemm.ee

qaz@lemmy.blahaj.zone

qaz@lemmy.dbzer0.com

qaz@lemmy.sdf.org

354

The Rule (lemmy.ml)

submitted 3 months ago by roon@lemmy.ml to c/196@lemmy.blahaj.zone

32 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Mikina@programming.dev 3 points 3 months ago (1 children)

VRAM would be 810Gb/403Gb/203Gb for FP16/FP8/INT4 for interferrence, according to their website.

[–] Gormadt@lemmy.blahaj.zone 2 points 3 months ago

Hot damn that's a lot! They ain't messing around with that requirement.

My current server has 32 MB of VRAM. Yes, MB not GB. Once I finish the hardware migration it's going to 8GB but that's not even a drop in the bucket compared to that requirement.