I came across Petals (github link here), a framework for distributed hosting and fine tuning of LLMs, and was curious about its use or enterprises.
The framework allows you to deploy LLMs to a private group of trusted peers, and I wonder how it could be used by an Enterprise who has a workforce of thousands all with their own laptops.
As an extension, could we think of the compute and storage resources available in the laptop pool of an enterprise as a resource? I know cloud costs are increasing rapidly.
Is there a future where cloud computing is actually an overlay on top of Enterprise owned laptop assets, distributed across their workforce?
Its unlikely to be suitable for all use-cases, but would it be ideal for some?
Is there a product here?
Leave a Reply