You get a GPU, you get a GPU, everyone gets a ZeroGPU!
Open source AI champion Hugging Face is making $10 million in GPU compute available to the public in a bid to ease the financial burden of model development faced by smaller dev teams.
Founded in 2016, Hugging Face has become a go-to source of open source AI models which have been optimized to run on a wide variety of hardware – thanks in part to closeDelangue regards open source as the way forward for AI innovation and adoption, so his biz is making a bounty of complete resources available to whoever needs it. ZeroGPU will be made available via its application hosting service and run atop Nvidia's older A100 accelerators – $10 million worth of them — on a shared basis.
In terms of how Hugging Face has gotten around having to dedicate entire GPUs to individual users, there's no shortage of ways to achieve this, depending on the level of isolation required. However, it's worth noting there are practical limits to all of these approaches – the big one being memory. Based on the support docs, Hugging Face appears to be using the 40GB variant of the A100. Even running 4-bit quantized models, that's only enough grunt to support a single 80 billion parameter model. Due to key-value cache overheads, the practical limit will be less.
Deutschland Neuesten Nachrichten, Deutschland Schlagzeilen
Similar News:Sie können auch ähnliche Nachrichten wie diese lesen, die wir aus anderen Nachrichtenquellen gesammelt haben.
Heart-stopping moment young girl comes face-to-face with mountain lionThe incident happened Saturday, when members of the Havener family were outside in their yard, enjoying the day.
Weiterlesen »
Jose Mourinho holds 'face-to-face talks' with European giants as return to management nearsJose Mourinho could have found his next club as he has held positive talks with European giants as 'negotiations continue'.
Weiterlesen »
Woman's face burned after 'Heinz spaghetti hoops explode in her face'Phoebe Mason was left with hoop-shaped scars following the explosion.
Weiterlesen »
Harry won't meet William on UK visit - but will see Charles face to faceWhile Prince Harry returning to the UK this week for the 10 years anniversary of the Invictus Games, he looks set to meet up with The King, but not with his brother
Weiterlesen »
Online treatment as effective as face-to-face for kids with anxiety, study findsAn online program to help children and teenagers beat anxiety has been shown to be as effective in the long term as treatment with a therapist, potentially improving access to care while saving families money.
Weiterlesen »
Stormont leaders request face-to-face talks with PM over ‘upfront investment’First Minister Michelle O’Neill said the Executive’s priority was to secure a ‘proper funding model’ from the Treasury.
Weiterlesen »