{"id":19,"date":"2023-12-22T01:54:43","date_gmt":"2023-12-22T01:54:43","guid":{"rendered":"https:\/\/khozouei.com\/?p=19"},"modified":"2023-12-22T01:55:44","modified_gmt":"2023-12-22T01:55:44","slug":"enterprise-distributed-compute","status":"publish","type":"post","link":"https:\/\/khozouei.com\/index.php\/2023\/12\/22\/enterprise-distributed-compute\/","title":{"rendered":"Enterprise distributed compute"},"content":{"rendered":"\n<p class=\"has-luminous-vivid-orange-color has-text-color has-link-color wp-elements-4aed000764249b995a77c3daa0ec4dba\">I came across Petals (<a href=\"https:\/\/github.com\/bigscience-workshop\/petals\" data-type=\"link\" data-id=\"https:\/\/github.com\/bigscience-workshop\/petals\">github link here<\/a>), a framework for distributed hosting and fine tuning of LLMs, and was curious about its use or enterprises. <\/p>\n\n\n\n<p class=\"has-luminous-vivid-orange-color has-text-color has-link-color wp-elements-5b00742253229f7b195a4d7c76328306\">The framework allows you to deploy LLMs to a private group of trusted peers, and I wonder how it could be used by an Enterprise who has a workforce of thousands all with their own laptops.<\/p>\n\n\n\n<p class=\"has-luminous-vivid-orange-color has-text-color has-link-color wp-elements-e7ddf13e27018ecc750d346453e6f9a0\">As an extension, could we think of the compute and storage resources available in the laptop pool of an enterprise as a resource?  I know cloud costs are increasing rapidly. <br><br>Is there a future where cloud computing is actually an overlay on top of Enterprise owned laptop assets, distributed across their workforce?<\/p>\n\n\n\n<p class=\"has-luminous-vivid-orange-color has-text-color has-link-color wp-elements-f28c9db257249175f7d3ae4e6af5c378\">Its unlikely to be suitable for all use-cases, but would it be ideal for some? <\/p>\n\n\n\n<p class=\"has-luminous-vivid-orange-color has-text-color has-link-color wp-elements-72582c743a7d58070cdc1ff4703cb363\">Is there a product here?<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I came across Petals (github link here), a framework for distributed hosting and fine tuning of LLMs, and was curious about its use or enterprises. The framework allows you to deploy LLMs to a private group of trusted peers, and I wonder how it could be used by an Enterprise who has a workforce of [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/khozouei.com\/index.php\/wp-json\/wp\/v2\/posts\/19"}],"collection":[{"href":"https:\/\/khozouei.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/khozouei.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/khozouei.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/khozouei.com\/index.php\/wp-json\/wp\/v2\/comments?post=19"}],"version-history":[{"count":2,"href":"https:\/\/khozouei.com\/index.php\/wp-json\/wp\/v2\/posts\/19\/revisions"}],"predecessor-version":[{"id":21,"href":"https:\/\/khozouei.com\/index.php\/wp-json\/wp\/v2\/posts\/19\/revisions\/21"}],"wp:attachment":[{"href":"https:\/\/khozouei.com\/index.php\/wp-json\/wp\/v2\/media?parent=19"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/khozouei.com\/index.php\/wp-json\/wp\/v2\/categories?post=19"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/khozouei.com\/index.php\/wp-json\/wp\/v2\/tags?post=19"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}