“Every time you look for the supposed gold mine, you find someone just handing someone money instead of the gold coming out.”Author of Where's Your Ed At and...
US (enterprise/kubarnetes) datacenters also average 5% gpu and 8% cpu utilization. Much of datacenter buildout is for “reserving” capacity, even if existing infrastructure could accomodate "spot rental"or “serverless” (let google/aws cram your work request into the machine of their choice) to get 6x+ more “tokens”.
US (enterprise/kubarnetes) datacenters also average 5% gpu and 8% cpu utilization. Much of datacenter buildout is for “reserving” capacity, even if existing infrastructure could accomodate "spot rental"or “serverless” (let google/aws cram your work request into the machine of their choice) to get 6x+ more “tokens”.