Skip to content

Features

The heart of OpenTrafficCam.

OTVision is a collection of algorithms to generate trajectories of road users from traffic videos. Most of the algorithms have been developed in previous open source projects. We modify them and link them with our own developments into a working pipeline.

The current pipeline consists of three core functionalities of OTVision: convert, detect and track.

graph LR
    subgraph OTVision["OTVision:"]
        direction LR
        conv(<b>convert</b>
        ...raw video
        files to mp4)
        det(<b>detect</b>
        ...road users
        in single
        frames)
        tr(<b>track</b>
        ...detected road
        users over
        multiple frames)
        conv --> det --> tr
    end
    tr .-> traj[/.ottrk
    Trajectories/]
    vf[/.mp4
    Video Files/] .-> det
    rvf[/.h264
    Video Files/] .-> conv

Key features

  • Can be used without programming knowledge
  • Conversion of .h264 video files to other formats (using ffmpeg)
  • Detection (joint localization and classification) of road users using state-of-the-art AI object detection models in single video frames (currently using YOLOv8 by Ultralytics)
  • Tracking of detected road users over multiple frames (currently using the IOU-Tracker by Bochinski et al.) and over multiple videos.
  • Result: Trajectories in pixel coordinates