Aiming at the high-end hardware that dominates the AI market and has caused China-specific GPU bans by the US, Chinese manufacturer Intellifusion is introducing "DeepEyes" AI boxes with touted AI performance of 48 TOPS for 1000 yuan, or roughly $140. Using an older 14mn node and (most likely) an ASIC is another way for China to sidestep sanctions and remain competitive in the AI market.
The first "Deep Eyes" AI box for 2024 leverages a DeepEdge10Max SoC for 48 TOPS in int8 training performance. The 2024 H2 Deep Eyes box will use a DeepEdge10Pro with up to 24 TOPS, and finally, the 2025 H1 Deep Eyes box is aiming at a considerable performance boost with the DeepEdge10Ultra's rating of up to 96 TOPS. The pricing of these upcoming higher-end models is unclear. Still, if they can maintain the starting ~1000 yuan cost long-term, Intellifusion may achieve their goal of "90% cheaper AI hardware" that still "covers 90% of scenarios".
All of those above fully domestically-produced hardware leverages Intellifusion's custom NNP400T neural networking chip. Besides the other expected components of SoCs, this specialized (a 1.8 GHz 2+8 cores RISC CPU, GPU up to 800 MHz in DeepEdge 10), the effective NPU onboard makes this a pretty tasty option inside its market.
For your reference, to meet Microsoft's stated requirements of an "AI PC," modern PCs must have at least 40 TOPS of NPU performance. So, Intellifusion's immediate trajectory seems like it should soon be suitable for many AI workloads, especially considering most existing NPUs are only as fast as 16 TOPS. However, Snapdragon's X Elite chips are set to boast 40 TOPS alongside industry-leading iGPU performance later this year.
As Dr. Chen Ning, chairman of Intellifusion, posted, "In the next three years, 80% of companies around the world will use large models. [...] The cost of training a large model is in the tens of millions, and the price of mainstream all-in-one training and pushing machines is generally one million yuan. Most companies cannot afford such costs."
While the claim that 80% of companies worldwide will be leveraging AI seems...questionable at best, a fair point is being made here about the cost of entry for businesses to make meaningful use of AI, especially in creating their models. The DeepEdge chips use "independent and controllable domestic technology" and a RISC-V core to support extensive model training and inference deployment.
