Yukihiro Sasagawa

High-level video analytics PC subsystem using SoC with heterogeneous multi-core architecture

The high-level video analytics PC subsystem as PCIe add-in card is developed for surveillance, retail marketing tool, and various applications which require acceleration of computer vision analytics for real-time video. The PC subsystem has multicore architecture SoC, which comprises proposed computer vision engine (CVE) based on the filter, optical flow extraction, object detection accelerators, and memory sharing using the L3 cache. The optical flow accelerator has parallel and pipelined datapath with tight-coupled DMA control scheme to improve performance and less latency. The object detection accelerator has the capability of online learning from images so that it can give a robustness of tracking targets. L3 cache contributes to shortening memory access latency. Heterogeneous structure with the CPU and CVE accelerator achieves performance at 3500 GOPS, and power efficiency at 1871 GOPS/W, it is approximately 2-15× higher performance and higher efficiency than other SoCs.