floofloof@lemmy.ca to Technology@lemmy.worldEnglish · 7 months ago1-bit LLMs Could Solve AI’s Energy Demandsspectrum.ieee.orgexternal-linkmessage-square36fedilinkarrow-up1120arrow-down115cross-posted to: singularity@lemmit.onlineartificial_intel@lemmy.ml
arrow-up1105arrow-down1external-link1-bit LLMs Could Solve AI’s Energy Demandsspectrum.ieee.orgfloofloof@lemmy.ca to Technology@lemmy.worldEnglish · 7 months agomessage-square36fedilinkcross-posted to: singularity@lemmit.onlineartificial_intel@lemmy.ml
minus-squareMiaou@jlai.lulinkfedilinkEnglisharrow-up3arrow-down1·7 months agoMulti bits models exist because thats how computers work, but there’s been a lot of work to use e.g. fixed point over floating for things like FPGAs, or with shorter integer types, and often results are more than good enough.
Multi bits models exist because thats how computers work, but there’s been a lot of work to use e.g. fixed point over floating for things like FPGAs, or with shorter integer types, and often results are more than good enough.