Cameras that see like eyes

How far are event-based (neuromorphic) vision sensors from mainstream use in phones, cars, robots and factories?

Event-based cameras report only the pixels whose brightness has changed, rather than full frames. Sony and Prophesee announced the IMX636 event sensor in 2021, and Prophesee sells a 1280 by 720 developer kit built on it. Industrial camera makers now sell products that use the sensor. Research shows fast response in drones and a hybrid event and frame system for car detection. The car result has not been shown on a moving vehicle in the sources reviewed, and the drone tests used research platforms. The sources reviewed show no phone, mainstream robot or production car that uses an event sensor.

AI illustration · Illustrative scene, not a photograph of the specific device or experiment.
WHERE WE AREPilots

Close. Early pilots are running in the real world.

Event sensors are sold as industrial cameras and developer kits, and drone and car prototypes have been shown. No phone, mainstream robot or production car is shown to use one. A 2021 driver-monitoring project was projected to reach passenger cars that year, but the sources reviewed name no vehicle. Limited commercial use with unresolved software and validation gaps fits pilot rather than scaling.

The tech tree

Everything recorded on Vrulum that this future needs, oldest foundations at the top and the goal at the bottom. Lines show what each step requires.

What it takes: Cameras that see like eyes Unlocked Being researched Locked
  1. 1856ManufacturingIndustrial steelmakingCommercial Unlocked.
  1. 1774ManufacturingPrecision machine tools and interchangeable partsCommercialRequires: Industrial steelmaking. Unlocked.
  1. 1967Modern systemsCar electronics and engine controlCommercial Unlocked.
  2. 3500 BCMovementThe wheel and axleCommercial Unlocked.
  3. 1712PowerThe steam engineCommercialRequires: Precision machine tools and interchangeable parts. Unlocked.
  4. 1859PowerLead-acid batteriesCommercial Unlocked.
  5. 1859PowerPetroleum refiningCommercial Unlocked.
  1. 1816ControlVehicle steeringCommercialRequires: The wheel and axle. Unlocked.
  2. 1827ControlClutches, gearboxes and differentialsCommercialRequires: Precision machine tools and interchangeable parts. Unlocked.
  3. 1902ControlVehicle brakesCommercialRequires: Car electronics and engine control. Unlocked.
  4. 1901ManufacturingAssembly-line mass productionCommercialRequires: Precision machine tools and interchangeable parts. Unlocked.
  5. 1952Modern systemsVehicle safety systemsCommercial Unlocked.
  6. 1956Modern systemsCatalytic convertersCommercial Unlocked.
  7. 1964Modern systemsSatellite navigation (GNSS)Commercial Unlocked.
  8. 1750MovementSprings and vehicle suspensionCommercialRequires: The wheel and axle. Unlocked.
  9. 1794MovementRolling bearingsCommercialRequires: Precision machine tools and interchangeable parts. Unlocked.
  10. 1844MovementVulcanised rubber and pneumatic tyresCommercialRequires: The wheel and axle. Unlocked.
  11. 1821PowerThe electric motorCommercialRequires: Industrial steelmaking. Unlocked.
  12. 1860PowerThe internal combustion engineCommercialRequires: The steam engine, Petroleum refining, Precision machine tools and interchangeable parts. Unlocked.
  13. 1976PowerLithium-ion batteriesCommercialRequires: Lead-acid batteries. Unlocked.
  1. 1769VehicleThe motor carCommercialRequires: The wheel and axle, Vulcanised rubber and pneumatic tyres, Springs and vehicle suspension, Rolling bearings, The internal combustion engine, The electric motor, Lead-acid batteries, Vehicle steering, Vehicle brakes, Clutches, gearboxes and differentials, Assembly-line mass production, Industrial steelmaking, Car electronics and engine control, Vehicle safety systems, Catalytic converters, Satellite navigation (GNSS), Lithium-ion batteries, Petroleum refining, Precision machine tools and interchangeable parts, The steam engine. Unlocked.
  1. 1990Neuromorphic computing chipsResearch and prototypes Being researched.
  2. 2008Event-based (neuromorphic) camerasCommercial Unlocked.
  3. 2019Autonomous road vehiclesPilot and early commercialRequires: The motor car, Satellite navigation (GNSS). Unlocked.
  1. 2020Drone avoids fast obstacles using an event cameraDone Unlocked.
  2. 2020Samsung event sensor reported in a research paperDone Unlocked.
  3. 2021Event sensor in car driver monitoringIn progress Being researched.
  4. 2021Event sensor announced for industrial useDone Unlocked.
  5. 2023Drone flight controlled by a spiking networkDone Unlocked.
  6. 2024Event and frame cameras combined for car detectionDone Unlocked.
  7. 2025Industrial event cameras on saleDone Unlocked.
  8. Date not recordedDeveloper kit for the HD event sensorDone Unlocked.
  9. Date not recordedReal-time test of event and frame fusion on a vehicleNot started Locked.
  10. Date not recordedShared software and benchmarks for event dataIn progress Being researched.
  1. GoalCameras that see like eyesGoalRequires: Event-based (neuromorphic) cameras, Neuromorphic computing chips, Autonomous road vehicles, Event sensor announced for industrial use, Developer kit for the HD event sensor, Samsung event sensor reported in a research paper, Industrial event cameras on sale, Event sensor in car driver monitoring, Event and frame cameras combined for car detection, Drone avoids fast obstacles using an event camera, Drone flight controlled by a spiking network, Real-time test of event and frame fusion on a vehicle, Shared software and benchmarks for event data. Locked.

The road so far

7 of 10 steps done, 2 in progress.

  1. Done · Sept 2021Event sensor announced for industrial use

    Sony and Prophesee announced the IMX636 (0.92 megapixel) and IMX637 (0.33 megapixel) event sensors in September 2021, with a 4.86 micrometre pixel. Sony said they were designed for industrial equipment. Sony's announcement gave no performance figures beyond resolution and pixel size. [4]

  2. DoneDeveloper kit for the HD event sensor

    Prophesee's EVK4 kit uses the IMX636 with 1280 by 720 pixels and pixel latency below 100 microseconds. Dynamic range is above 86 dB measured from 5 to 100,000 lux, or above 120 dB when measured from the 0.08 lux low-light cutoff. Prophesee does not state the sensor's power consumption or peak event rate on the page, and the page gives no launch date. [5]

  3. Done · Oct 2020Samsung event sensor reported in a research paper

    Samsung reported a 1280 by 960 dynamic vision sensor with 4.95 micrometre pixels in a 2020 conference paper. The authors report 122 nW per pixel, 1.25 times smaller than the previous state of the art, as the Image Sensors World post quotes the paper. The post gives no baseline figure. No Samsung event sensor product was found in the sources reviewed. [6]

  4. Done · Mar 2025Industrial event cameras on sale

    Prophesee lists IDS's uEye EVS industrial camera series, launched on 5 March 2025 with the IMX636, and a CenturyArks camera module launched on 28 October 2025. In March 2026 IDS and Prophesee signed a letter of intent to develop next-generation industrial vision systems, with no products, volumes or dates named. [7][8]

  5. In progress · Apr 2021Event sensor in car driver monitoring

    In April 2021 DTS, an Xperi subsidiary, announced its AutoSense driver and occupant monitoring system, built on neuromorphic (event-based) vision. The release named no automaker or vehicle model, and the sources reviewed do not confirm a production car using it. In February 2021 Terranet's VoxelFlow system, built from three event cameras and a continuous laser scanner, was presented jointly with Mercedes-Benz at STARTUP AUTOBAHN. The post does not say Mercedes-Benz deploys the system. The figures are the company's, and no production vehicle is confirmed. [10][11]

  6. Done · May 2024Event and frame cameras combined for car detection

    Gehrig and Scaramuzza pair a 20 fps RGB camera with an event camera. The authors report that the pair matches the latency of a 5,000 fps camera while using the bandwidth of a 45 fps camera, and they propose a hybrid event and frame object detector. The full text was not reachable, so these figures rest on the abstract as reported in a search summary. The sources reviewed do not show a real-time test on a moving vehicle. [1]

  7. Done · Mar 2020Drone avoids fast obstacles using an event camera

    Falanga, Kleber and Scaramuzza report a quadrotor that used event cameras to dodge approaching obstacles. The authors give an overall latency of about 3.5 ms for the algorithm. The test used a research quadrotor, not a commercial product. [2]

  8. Done · Mar 2023Drone flight controlled by a spiking network

    Paredes-Vallés and colleagues report a spiking neural network trained on raw event-camera data that runs on board Intel's Loihi neuromorphic processor at an execution frequency of 200 Hz. The 2023 preprint reports 27 microjoules per inference. A 2024 journal version was not opened in this review. [3]

  9. Not startedReal-time test of event and frame fusion on a vehicle

    The hybrid automotive study did not report a real-time system tested on a moving vehicle, as far as the sources reviewed show. No on-vehicle trial with published end-to-end latency has been found. [1]

  10. In progressShared software and benchmarks for event data

    Surveys describe many methods for event data, including deep learning. The sources reviewed do not show a single representation or benchmark adopted across vendors. Zheng and colleagues state that deep learning for event-based vision still lacks a taxonomy of techniques. [12][13]

Why it matters

Event sensors respond in microseconds and handle very bright and very dark areas in the same scene. If they become cheap and easy to program, machines could react faster on small batteries and send less data. Most vision software and training data still assume frames, so the software and data gaps will decide how quickly this moves beyond specialist use.

What stands in the way

  • Most vision software and training data assume full frames. Event streams need new representations and algorithms, and the surveys say these are still being developed.
  • Labelled event data and shared benchmarks. The sources reviewed do not show a common labelled dataset for automotive event detection. The full text of the 2024 hybrid automotive study was not reachable, so how its training labels were made could not be checked.
  • Size, cost and volume. In 2019 Prophesee's Verre said the packaged sensor was too big for mainstream automotive use, and that cost and volume had to improve before mass markets could be reached.
  • Vendor figures often lack test conditions. Prophesee's sensor page gives no power figure, and throughput and power claims from vendors have not been tested independently in the sources reviewed.
  • Validation in cars. The strongest automotive result has not been shown on a moving vehicle in the sources reviewed. No real-time on-vehicle test with published latency has been found.
  • Controlled settings. iniVation's DVXplorer documentation says the camera is intended for laboratory and industrial use under controlled conditions.

Published forecasts

What others have predicted. These are their estimates, not ours.

WhoForecastTimeframeMade
DTS (Xperi), in a 2021 product releaseIts AutoSense driver monitoring system would be the first designed into passenger vehicles projected to be on the road in 2021. The release names no vehicle, and the sources reviewed do not confirm that this happened. [10]202121 Apr 2021

Signals to watch

  • A named automaker or Tier 1 supplier announcing a production vehicle model that uses an event sensor.
  • On-vehicle, real-time tests of event and frame fusion that report end-to-end latency and power.
  • An event sensor in a phone or consumer device, with the sensor maker named.
  • A common data format and public benchmark for event-based detection adopted by several vendors.
  • The IDS and Prophesee partnership naming products, volumes or dates, as the 2026 letter of intent aims to develop next-generation industrial systems.

Sources

  1. peer reviewed paper
    Low-latency automotive vision with event cameras
    Daniel Gehrig, Davide Scaramuzza. Nature, 29 May 2024.
  2. peer reviewed paper
    Dynamic obstacle avoidance for quadrotors with event cameras
    Davide Falanga, Kevin Kleber, Davide Scaramuzza. Science Robotics, Mar 2020.
  3. preprint
    Fully neuromorphic vision and control for autonomous drone flight
    Federico Paredes-Vallés, Jesse Hagenaars, Julien Dupeyroux et al.. arXiv (preprint), 15 Mar 2023.
  4. news
    Sony Announces Two 4.86um Pixel Event-Based Sensors Developed with Prophesee
    Image Sensors World (blog), 9 Sept 2021.
  5. company announcement
    Event Camera Evaluation Kit 4 HD IMX636 Prophesee-Sony
    Prophesee, Apr 2022.
  6. news
    Samsung Presents 1.3MP Event-Driven Sensor with 4.95um Pixels
    Yunjae Suh. Image Sensors World (blog), quoting a 2020 conference paper, 3 Oct 2020.
  7. company announcement
    Everything That Happened at Prophesee in 2025
    Prophesee, 7 Jan 2026.
  8. company announcement
    IDS and Prophesee to Advance Event-Based Industrial Vision
    Prophesee, 11 Mar 2026.
  9. news
    Event-Driven Vision Hits Production Lines
    EE Times, 25 Sept 2019.
  10. company announcement
    Xperi Develops World-first In-cabin Monitoring Technologies on Neuromorphic Vision Systems
    Prophesee (copy of the DTS and Xperi release), 21 Apr 2021.
  11. news
    Terranet and Mercedes-Benz Present Quick Reacting Event-Based Camera System
    Image Sensors World (blog), reposting a Terranet release of 25 February 2021, 16 Mar 2021.
  12. review article
    Event-based Vision: A Survey
    Guillermo Gallego, Tobi Delbruck, Garrick Orchard et al.. IEEE Transactions on Pattern Analysis and Machine Intelligence, Jan 2022.
  13. preprint
    Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarks
    Xu Zheng, Yexin Liu, Yunfan Lu et al.. arXiv, 17 Feb 2023.
  14. other
    DVXplorer product documentation
    iniVation AG, 26 May 2026.

Last reviewed 21 Oct 2026.