The firm Tiiny AI unveiled the AI Pocket Lab mini-PC. This is an extremely compact offering roughly the size of a smartphone (just thicker), which has already entered the Guinness Book of Records in the category The Smallest MiniPC (100B LLM Locally).
This means it is the smallest computer capable of locally running a large language model totaling 100 billion parameters. More accurately, the company mentions 120 billion parameters.
Full specifics are unavailable, but it is known that the novelty utilizes a 12-core processor based on the Arm v9.2 architecture. Apparently, separate from the processor, there is also a certain heterogeneous system-on-a-chip and a discrete NPU, which combined deliver a performance of 190 TOPS.
The 80 GB of LPDDR5X memory appears quite substantial given the dimensions. There is also a 1 TB SSD present.
Cloud AI has brought wonderful advancement, but has also created dependency, vulnerability, and sustainability issues. With the Tiiny AI Pocket Lab, we believe intelligence should belong to individuals, not data centers. This is the initial stride toward making cutting-edge AI genuinely accessible, private, and tailored, moving the capabilities of large models from the cloud to every individual device.
The system consumes around 65 W, so the mini-PC is equipped with active cooling. The dimensions are 142 x 80 x 25.3 mm with a weight of 300 g. Pricing details are not yet available.
About the Author
