Isn’t it just the training that costs a lot in comparison to running it? So if they stopped training new models and just sold their current ones it might be able to run at a profit from year to year, after a huge initial investment that may or may not ever be recovered.
Not really. The infrastructure to run language models is hardware wise demanding, consumes vast amounts of water (cooling) and electricity and requires frequent renewing and added capacity.
Isn’t it just the training that costs a lot in comparison to running it? So if they stopped training new models and just sold their current ones it might be able to run at a profit from year to year, after a huge initial investment that may or may not ever be recovered.
Not really. The infrastructure to run language models is hardware wise demanding, consumes vast amounts of water (cooling) and electricity and requires frequent renewing and added capacity.
My PC can run some LLMs