tracking. Tracking API¶
Long-term optical tracking API¶
Long-term optical tracking is one of most important issue for many computer vision applications in real world scenario. The development in this area is very fragmented and this API is an unique interface useful for plug several algorithms and compare them. This work is partially based on [AAM] and [AMVOT].
This algorithms start from a bounding box of the target and with their internal representation they avoid the drift during the tracking. These long-term trackers are able to evaluate online the quality of the location of the target in the new frame, without ground truth.
There are three main components: the TrackerSampler, the TrackerFeatureSet and the TrackerModel. The first component is the object that computes the patches over the frame based on the last target location. The TrackerFeatureSet is the class that manages the Features, is possible plug many kind of these (HAAR, HOG, LBP, Feature2D, etc). The last component is the internal representation of the target, it is the appearence model. It stores all state candidates and compute the trajectory (the most likely target states). The class TrackerTargetState represents a possible state of the target. The TrackerSampler and the TrackerFeatureSet are the visual representation of the target, instead the TrackerModel is the statistical model.
A recent benchmark between these algorithms can be found in [OOT].
UML design:¶
General diagram
Tracker diagram
TrackerSampler diagram
TrackerFeatureSet diagram
TrackerModel diagram
To see how API works, try tracker demo: https://github.com/lenlen/opencv/blob/tracking_api/samples/cpp/tracker.cpp
Note
This Tracking API has been designed with PlantUML. If you modify this API please change UML files under modules/tracking/misc/
The following reference was used in the API
| [AAM] | S Salti, A Cavallaro, L Di Stefano, Adaptive Appearance Modeling for Video Tracking: Survey and Evaluation, IEEE Transactions on Image Processing, Vol. 21, Issue 10, October 2012, pp. 4334-4348 |
| [AMVOT] | X Li, W Hu, C Shen, Z Zhang, A Dick, A van den Hengel, A Survey of Appearance Models in Visual Object Tracking, ACM Transactions on Intelligent Systems and Technology (TIST), 2013 |
| [OOT] | Yi Wu and Jongwoo Lim and Ming-Hsuan Yang, Online Object Tracking: A Benchmark, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013 |
Tracker classes:¶
- Tracker Algorithms
- Common Interfaces of Tracker
- Common Interfaces of TrackerSampler
- Specialized TrackerSamplerAlgorithm
- TrackerSamplerCSC : TrackerSamplerAlgorithm
- TrackerSamplerCSC::Params
- TrackerSamplerCSC::TrackerSamplerCSC
- TrackerSamplerCSC::setMode
- TrackerSamplerCS : TrackerSamplerAlgorithm
- TrackerSamplerCS::Params
- TrackerSamplerCS::TrackerSamplerCS
- TrackerSamplerCS::setMode
- TrackerSamplerPF : TrackerSamplerAlgorithm
- TrackerSamplerPF::Params
- TrackerSamplerPF::TrackerSamplerPF
- Common Interfaces of TrackerFeatureSet
- TrackerFeatureSet
- TrackerFeatureSet::extraction
- TrackerFeatureSet::selection
- TrackerFeatureSet::removeOutliers
- TrackerFeatureSet::addTrackerFeature
- TrackerFeatureSet::getTrackerFeature
- TrackerFeatureSet::getResponses
- TrackerFeature
- TrackerFeature::create
- TrackerFeature::compute
- TrackerFeature::selection
- TrackerFeature::getClassName
- Specialized TrackerFeature
- TrackerFeatureHAAR : TrackerFeature
- TrackerFeatureHAAR::Params
- TrackerFeatureHAAR::TrackerFeatureHAAR
- TrackerFeatureHAAR::selection
- TrackerFeatureHAAR::extractSelected
- TrackerFeatureHAAR::getMeanSigmaPairs
- TrackerFeatureHAAR::swapFeature
- TrackerFeatureHAAR::getFeatureAt
- TrackerFeatureHOG
- TrackerFeatureLBP
- TrackerFeatureFeature2d
- Common Interfaces of TrackerModel
- ConfidenceMap
- Trajectory
- TrackerTargetState
- TrackerStateEstimator
- TrackerStateEstimator::create
- TrackerStateEstimator::estimate
- TrackerStateEstimator::update
- TrackerStateEstimator::getClassName
- TrackerModel
- TrackerModel::modelEstimation
- TrackerModel::modelUpdate
- TrackerModel::runStateEstimator
- TrackerModel::setTrackerStateEstimator
- TrackerModel::setLastTargetState
- TrackerModel::getLastTargetState
- TrackerModel::getConfidenceMaps
- TrackerModel::getLastConfidenceMap
- TrackerModel::getTrackerStateEstimator
- Specialized TrackerStateEstimator
- TrackerStateEstimatorMILBoosting : TrackerStateEstimator
- TrackerMILTargetState : TrackerTargetState
- TrackerStateEstimatorMILBoosting::TrackerMILTargetState::setTargetFg
- TrackerStateEstimatorMILBoosting::TrackerMILTargetState::setFeatures
- TrackerStateEstimatorMILBoosting::TrackerMILTargetState::isTargetFg
- TrackerStateEstimatorMILBoosting::TrackerMILTargetState::getFeatures
- TrackerStateEstimatorMILBoosting::TrackerStateEstimatorMILBoosting
- TrackerStateEstimatorMILBoosting::setCurrentConfidenceMap
- TrackerStateEstimatorAdaBoosting : TrackerStateEstimator
- TrackerAdaBoostingTargetState : TrackerTargetState
- TrackerStateEstimatorAdaBoosting::TrackerAdaBoostingTargetState::setTargetFg
- TrackerStateEstimatorAdaBoosting::TrackerAdaBoostingTargetState::setTargetResponses
- TrackerStateEstimatorAdaBoosting::TrackerAdaBoostingTargetState::isTargetFg
- TrackerStateEstimatorAdaBoosting::TrackerAdaBoostingTargetState::getTargetResponses
- TrackerStateEstimatorAdaBoosting::TrackerStateEstimatorAdaBoosting
- TrackerStateEstimatorAdaBoosting::setCurrentConfidenceMap
- TrackerStateEstimatorAdaBoosting::getSampleROI
- TrackerStateEstimatorAdaBoosting::setSampleROI
- TrackerStateEstimatorAdaBoosting::computeSelectedWeakClassifier
- TrackerStateEstimatorAdaBoosting::computeReplacedClassifier
- TrackerStateEstimatorAdaBoosting::computeSwappedClassifier
- TrackerStateEstimatorAdaBoosting::setMeanSigmaPair
Help and Feedback
You did not find what you were looking for?- Ask a question on the Q&A forum.
- If you think something is missing or wrong in the documentation, please file a bug report.
