Embedded vision computing for real-time robotics:
The demo system congatec designed in cooperation with Intel® and Real-Time Systems targets the next generation of vision based collaborative robotics, automation controls and autonomous vehicles that have to tackle multiple tasks in parallel, including situational awareness utilizing deep learning based AI algorithms. The solution ready platform is based on a COM Express Type 6 module equipped with Intel® Xeon® E2 processor and integrates three preconfigured virtual machines. One operates a Basler vision camera, where the vision based object recognition runs on Linux via the Intel® OpenVino® software, and the AI algorithms are executed on an Intel® Arria® 10 FPGA card from Refexces. Another partition hosts a gateway for secure IoT connectivity. The independent real-time partition runs real-time Linux to control the balance of an inverted pendulum in real-time. Visitors can try to disturb the balance of the pendulums – the system will react instantly and with real-time behavior to keep the pendulums in balance.