The TinyBox AI Accelerator is currently available on the tinygrad website with a starting price of $15,000. The small, 16.25-inch deep, 12U freestanding unit is equipped with six AMD Radeon RX 7900XTX or Nvidia GeForce RTX 4090 GPUs designed for deep learning and AI acceleration applications. While the computer is relatively expensive compared to consumer gaming desktop PCs, it's still far more affordable than a single Nvidia H100 or AMD MI300X accelerator, which can cost anywhere between $10,000 and $40,000 each.
After 18 months of being a company, tinyboxes finally have a buy now button. We currently have 13 in stock. Visit our website (link: @__tinygrad__) to buy one. At $15,000, the tinybox red is the best performance/price ML box in the world. It's fully networkable, which is a key metric. pic.twitter.com/gFxc873Q1yAugust 26, 2024
Tinygrad founder George Hotz shared the news of TinyBox availability at X, saying that he had 13 units in stock as of August 27. He also claims that the product is the “world's best performance/price ML box” and is fully networkable. The company faced some challenges with the AMD GPUs it uses in its systems, but was eventually able to find a solution to the problem. At the same time, it also added the option to use Nvidia GPUs instead to avoid AMD's driver instability, but this comes at a 67% premium.
Swipe to scroll horizontallyHeaderCell – Column 0 RedGreenTFLOPS738 FP16TFLOPS991 FP16TFLOPSSGPU Model6x RX 7900XTX6x RTX 4090GPU RAM144GB144GBGPU RAM Bandwidth5,760 GB/sec6,050 GB/secGPU Link Bandwidth6x PCIe 4.0 x16 (64 GB/sec)6x PCIe 4.0 x16 (64 GB/sec)CPU32 Core AMD EPYC32 Core AMD EPYCSystem RAM128 GB128 GBSystem RAM Bandwidth204.8 GB/sec204.8 GB/secDisk Size4TB RAID Array + 1TB Boot4TB RAID Array + 1TB BootDisk Read Bandwidth28.7 GB/sec28.7 GB/secNetwork2x 1 Gbe + Open OCP3.0 slots (up to 200 Gbe)2x 1 Gbe + Open OCP3.0 slots (up to 200 Gbe)Noise<50 dB, 31 low speed fans<50 dB, 31 low speed fansPower supply2x 1600 W, 100~240V2x 1600 W, 100~240VBMCAST2500AST2500Operating systemUbuntu 22.04Ubuntu 22.04Dimensions12U, 16.25 in. deep, 90 lbs12U, 16.25 in. deep, 90 lbsRack mountFreestanding or rack mountFreestanding or rack mountDriver qualityAcceptableGreat price$15,000$25,000
Despite the seemingly high price tag, the company has reportedly already received 583 pre-orders for the system. And now that the furore over AMD's GPUs is over, tinygrad seems ready to go full steam ahead selling its TinyBox AI accelerators. Businesses can choose between the more affordable AMD GPUs or the Nvidia systems. But as tinygrad previously tweeted, “If you like tinkering and struggling, buy the red. The driver still crashes the GPU and hangs every now and then, but we can work together to improve it.”
Our factories are in full swing! If you pre-ordered tinybox but haven't heard back, please contact us at [email protected]. Public sales will begin soon. pic.twitter.com/xljpYU1HjvAugust 26, 2024
We would like to believe that the issues with AMD GPUs have finally been resolved, which is why they are now being brought to market. However, given Nvidia's popularity in the AI accelerator field, it makes sense that they would offer this option as well. The only disappointment is that the TinyBox with Intel Arc is still in the prototype stage and is not scheduled to ship. It would have been nice to have that option available, but we hope that the company will change its mind and start shipping the “blue” model of the TinyBox in the future.
