Earlier last month, Samsung expanded its proprietary NPU technology development and also delivered an update to the same. At the Computer Vision and Pattern Recognition (CVPR), the company introduced its On-Device AI lightweight algorithm and today, Samsung has announced an update to the same.
Samsung has announced that the company has successfully developed On-Device AI lightweight technology that performs computations 8 times faster than the existing 32-bit deep learning data for servers. A core feature of On-Device AI technology is its ability to compute large amounts of data at a high speed without consuming excessive amounts of electricity.
How On-Device AI lightweight technology works?
The technology determines the intervals of the significant data that influence overall deep learning performance through learning and Samsung Advanced Institute of Technology (SAIT) is said to have run experiments that successfully demonstrated how the quantization of an in-server deep learning algorithm in 32 bit intervals provided higher accuracy than other existing solutions when computed into levels of less than 4 bits.
The computation results using the QIL process can achieve the same results as existing processes can while using 1/40 to 1/120 fewer transistors when the data of a deep learning computation is presented in bit groups lower than 4 bits, computations of ‘and’ and ‘or’ are allowed, on top of the simpler arithmetic calculations of addition and multiplication.
On-Device AI technology can reduce the cost of cloud construction for AI operations since it operates on its own and provides quick and stable performance for use cases such as virtual reality and autonomous driving.
Samsung’s first solution to this end was the Exynos 9 (9820), which featured a proprietary Samsung NPU inside the mobile System on Chip (SoC).
Commenting on this, Chang-Kyu Choi, Vice President and head of Computer Vision Lab of SAIT said:
Ultimately, in the future, we will live in a world where all devices and sensor-based technologies are powered by AI. Samsung’s On-Device AI technologies are lower-power, higher-speed solutions for deep learning that will pave the way to this future. They are set to expand the memory, processor and sensor market, as well as other next-generation system semiconductor markets.