DREEM io module.¶
The io module contains classes for storing, manipulating and generating model inputs and outputs.
There are 6 main submodules:
Instancewhich represent detections. They are the main input into the model and contain- GT Track ID
- Predicted Track ID
- the crop of the image
- the location as a centroid
(x,y), bounding box(y_1, x_1, y_2, x_2)and (optionally) the pose(1, n, 2) - the features extracted by the visual encoder + spatiotemporal embedding
- association score
Framewhich stores the metadata for a single frame of a video. It contains:- The video index
- The video name
- The frame index
- The list of
Instances that appear in that frame - The
AssociationMatrixbetween the instances in that frame and all instances in the window
Configwhich stores and parses the configs for training and/orAssociationMatrixwhich stores theGlobalTrackingTransformeroutput.AssociationMatrix[i,j]represents the association score between theith query instance and thejth instance in the window.Trackwhich stores references to all instances belonging to the same trajectoryvisualizewhich contains util functions for generating videos annotated by the predicted tracks and scores.