A computer implemented method for controlling a system moving through an environment includes receiving a stream of event data from an event camera, the stream of event data representing a pixel location, a time stamp, and a polarity for each event detected by the event camera. A compressed representation of the stream of data is generated. The compressed representation is provided to a neural network model trained on prior compressed representations using reinforcement learning to learn actions for controlling the system. A control action is generated via the neural network model to control the movement of the system.
Event camera based navigation control
17.10.2023
Patent
Elektronische Ressource
Englisch
IPC: | G06V / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G05D SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES , Systeme zum Steuern oder Regeln nichtelektrischer veränderlicher Größen / H04N PICTORIAL COMMUNICATION, e.g. TELEVISION , Bildübertragung, z.B. Fernsehen / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS |