International Journal of Emerging Research in Engineering, Science, and Management
Vol. 5, Issue 2, pp. 23-35, Apr-Jun 2026.
https://doi.org/10.58482/ijeresm.v5i2.2

Received: 21 Jan 2026 | Revised: 10 Apr 2026 | Accepted: 21 Apr 2026 | Published: 28 Apr 2026

This work is licensed under a Creative Commons Attribution 4.0 International License.

Feature Fusion Strategy Based on Concatenation of Histogram of Oriented Gradients and Pretrained CNN Features for Visual Object Tracking

Full Text PDF

1Villari Sreenatha Sarma

2P.M. Ashok Kumar

3Vadamala Purandhar Reddy

1,2Department of Computer Science and Engineering, Koneru Lakshmaiah Education Foundation, Vaddeswaram, Guntur, Andhra Pradesh, India.

1,3Audisankara College of Engineering & Technology, Gudur, Andhra Pradesh, India.

Abstract: This paper presents a hybrid feature fusion approach for visual object tracking that combines hand-crafted gradient-based descriptors with semantic representations extracted from a pretrained convolutional neural network. The proposed tracker integrates Histogram of Oriented Gradients (HOG) features with ResNet-50-based deep features within a correlation filter framework to improve robustness against appearance variations, occlusion, and illumination changes. A concatenation-based fusion strategy with adaptive confidence-driven weighting is incorporated to dynamically balance the contribution of handcrafted and deep features during tracking. The architecture employs parallel feature extraction branches and multi-scale feature integration to enhance localization performance while maintaining computational efficiency. Experimental evaluation on standard benchmark datasets, including OTB-2015 and related tracking sequences, demonstrates that the proposed fusion strategy provides improved performance compared with individual feature-based tracking approaches and achieves competitive results relative to baseline correlation-filter trackers under challenging conditions. The study also outlines potential directions for further enhancement through online adaptation and attention-based feature fusion strategies.

Keywords: Visual Object Tracking, Feature Fusion, Histogram of Oriented Gradients, Correlation Filter Tracking, Adaptive Feature Weighting.

References
  1. M. Kristan et al., "The Visual Object Tracking VOT2015 Challenge Results," 2015 IEEE International Conference on Computer Vision Workshop (ICCVW), pp. 564–586, 2015. https://doi.org/10.1109/ICCVW.2015.79
  2. Y. Wu, J. Lim, and M.-H. Yang, "Object Tracking Benchmark," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 37, no. 9, pp. 1834–1848, Sept. 2015. https://doi.org/10.1109/TPAMI.2014.2388226
  3. D. S. Bolme, J. R. Beveridge, B. A. Draper, and Y. M. Lui, "Visual Object Tracking Using Adaptive Correlation Filters," 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2544–2550, 2010. https://doi.org/10.1109/CVPR.2010.5539960
  4. J. F. Henriques, R. Caseiro, P. Martins, and J. Batista, "High-Speed Tracking with Kernelized Correlation Filters," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 37, no. 3, pp. 583–596, Mar. 2015. https://doi.org/10.1109/TPAMI.2014.2345390
  5. M. Danelljan, G. Häger, F. S. Khan, and M. Felsberg, "Learning Spatially Regularized Correlation Filters for Visual Tracking," 2015 IEEE International Conference on Computer Vision (ICCV), pp. 4310–4318, 2015. https://doi.org/10.1109/ICCV.2015.490
  6. L. Bertinetto, J. Valmadre, S. Golodetz, O. Miksik, and P. H. S. Torr, "Staple: Complementary Learners for Real-Time Tracking," 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1401–1409, 2016. https://doi.org/10.1109/CVPR.2016.156
  7. S. Hu, L. Sun, and H. Yu, "Accurate Visual Tracking with Attention Feature Fusion," 2021 26th International Conference on Automation and Computing (ICAC), pp. 1–6, 2021. https://doi.org/10.23919/ICAC50006.2021.9594244
  8. M. J. Swain and D. H. Ballard, "Color Indexing," International Journal of Computer Vision, vol. 7, no. 1, pp. 11–32, Nov. 1991. https://doi.org/10.1007/BF00130487
  9. D. Wang, W. Fang, W. Chen, T. Sun, and A. T. Chen, "Model Update Strategies About Object Tracking: A State of the Art Review," Electronics, vol. 8, no. 11, p. 1207, Oct. 2019. https://doi.org/10.3390/electronics8111207
  10. M. Masood and G. Raja, "An Adaptive Learning Based Aberrance Repressed Multi-Feature Integrated Correlation Filter for Visual Object Tracking (VOT)," Mehran University Research Journal of Engineering and Technology, vol. 43, no. 4, p. 14, Oct. 2024. https://doi.org/10.22581/muet1982.2832
  11. W. Xing et al., "Correlation Filter Based Visual Object Tracking," Visual Object Tracking from Correlation Filter to Deep Learning, ch. 3, Springer, 2021. https://doi.org/10.1007/978-981-16-6242-3_3
  12. S. Du and S. Wang, "An Overview of Correlation-Filter-Based Object Tracking," IEEE Transactions on Computational Social Systems, vol. 9, no. 1, pp. 18–31, Feb. 2022. https://doi.org/10.1109/TCSS.2021.3093298
  13. S. Jiang, S. Li, C. Zhu, and N. Yan, "Efficient Correlation Filter Tracking with Adaptive Training Sample Update Scheme," 2020 25th International Conference on Pattern Recognition (ICPR), pp. 549–555, 2021. https://doi.org/10.1109/ICPR48806.2021.9413005
  14. B. Li, J. Yan, W. Wu, Z. Zhu, and X. Hu, "High Performance Visual Tracking with Siamese Region Proposal Network," 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8971–8980, 2018. https://doi.org/10.1109/CVPR.2018.00935
  15. Z. Hong, Z. Chen, C. Wang, X. Mei, D. Prokhorov, and D. Tao, "MUlti-Store Tracker (MUSTer): A Cognitive Psychology Inspired Approach to Object Tracking," 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 749–758, 2015. https://doi.org/10.1109/CVPR.2015.7298675
  16. H. K. Galoogahi, T. Sim, and S. Lucey, "Correlation Filters with Limited Boundaries," 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4630–4638, 2015. https://doi.org/10.1109/CVPR.2015.7299094
  17. H. K. Galoogahi, A. Fagg, and S. Lucey, "Learning Background-Aware Correlation Filters for Visual Tracking," 2017 IEEE International Conference on Computer Vision (ICCV), pp. 1144–1152, 2017. https://doi.org/10.1109/ICCV.2017.129
  18. C. Zhu, S. Jiang, S. Li, and X. Lan, "Efficient and Practical Correlation Filter Tracking," Sensors, vol. 21, no. 3, p. 790, Jan. 2021. https://doi.org/10.3390/s21030790
  19. Y. Xiao, Y. Wu, and F. Xu, "An Adaptive Correlation Filtering Tracker with Dual Feature Channels," Journal of Visual Communication and Image Representation, vol. 111, p. 104556, Aug. 2025. https://doi.org/10.1016/j.jvcir.2025.104556
  20. H. Fan and H. Ling, "Parallel Tracking and Verifying: A Framework for Real-Time and High Accuracy Visual Tracking," 2017 IEEE International Conference on Computer Vision (ICCV), pp. 5487–5495, 2017. https://doi.org/10.1109/ICCV.2017.585
  21. P. Liang, E. Blasch, and H. Ling, "Encoding Color Information for Visual Tracking: Algorithms and Benchmark," IEEE Transactions on Image Processing, vol. 24, no. 12, pp. 5630–5644, Dec. 2015. https://doi.org/10.1109/TIP.2015.2482905
  22. M. Mueller, N. Smith, and B. Ghanem, "A Benchmark and Simulator for UAV Tracking," Lecture Notes in Computer Science, pp. 445–461, 2016. https://doi.org/10.1007/978-3-319-46448-0_27
  23. S. Hu, Y. Ge, J. Han, and X. Zhang, "Object Tracking Algorithm Based on Dual Color Feature Fusion with Dimension Reduction," Sensors, vol. 19, no. 1, p. 73, Dec. 2018. https://doi.org/10.3390/s19010073
  24. Y. Li and J. Zhu, "A Scale Adaptive Kernel Correlation Filter Tracker with Feature Integration," Lecture Notes in Computer Science, pp. 254–265, 2015. https://doi.org/10.1007/978-3-319-16181-5_18
  25. K. Zhang, L. Zhang, and M.-H. Yang, "Real-Time Compressive Tracking," Lecture Notes in Computer Science, pp. 864–877, 2012. https://doi.org/10.1007/978-3-642-33712-3_62
  26. P. Li, B. Chen, W. Ouyang, D. Wang, X. Yang, and H. Lu, "GradNet: Gradient-Guided Network for Visual Object Tracking," 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 6161–6170, 2019. https://doi.org/10.1109/ICCV.2019.00626
  27. R. T. Collins, Y. Liu, and M. Leordeanu, "Online Selection of Discriminative Tracking Features," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 10, pp. 1631–1643, Oct. 2005. https://doi.org/10.1109/TPAMI.2005.205
Download PDF

This article is part of Volume 5, Issue 2 (Apr–Jun 2026)

×

© 2026 The Author(s). Published by IJERESM. This work is licensed under the Creative Commons Attribution 4.0 International License.

Archiving: All articles are permanently archived in Zenodo IJERESM Community.