These AI PCs/Notebooks aren’t even able to run the really big models. For those you’d need a 5000$ card. And for the smaller models a good graphics card is often enough.
For a real AI PC we would need new technology or graphics cards with more ram (the last one would suprise me with current ram prices)
Necessity spite is usually a good driver…though given BITNET is Microsoft IP…ehh…I won’t hold my breath for too long. Still waiting for their 70B model to drop… maybe this year…
These AI PCs/Notebooks aren’t even able to run the really big models. For those you’d need a 5000$ card. And for the smaller models a good graphics card is often enough.
For a real AI PC we would need new technology or graphics cards with more ram (the last one would suprise me with current ram prices)
I’m still sanguine that 1.58 BITNET models take off. Those could plausibly run at good clip on existing CPUs, no GPU needed.
Super basic medium article for those not in know
https://medium.com/@kondwani0099/reimagining-ai-efficiency-a-practical-guide-to-using-bitnets-1-bit-llm-on-cpus-without-ef804d3fb875
Necessityspite is usually a good driver…though given BITNET is Microsoft IP…ehh…I won’t hold my breath for too long. Still waiting for their 70B model to drop… maybe this year…