Expertise: Video Analysis
SAM3 Expertise Areas: Video Analysis
Video provides a rich source of data and through analysis that can lead to knowledge about well-being. Video is applied carefully given the privacy intrusion that it represents. SAM3 researchers have used video analysis for a number of applications.
Video applications
- Gait and other motion assessment
- Kitchen use and kitchen safety
- Driving assessment
- Driver gaze assessment
- Cognitive assessment
- Thermal and RGB camera based assessment
See also our work on Video Magnification
Select A. Laghai, S. Shafiyan, N. Thomas, M. Kunz, K. Fraser, B. Wallace, R. Goubran, F. Knoefel, “Can Gaze–Speech Coupling in Reading Help Clinicians Detect Cognitive Decline Remotely?” ISG 2026 A. Laghai, S. Shafiyan, N. Thomas, M. Kunz, K. Fraser, B. Wallace, R. Goubran, F. Knoefel, “Can Gaze–Speech Coupling in Reading Help Clinicians Detect Cognitive Decline Remotely?” ISG 2026
T. Sloan, B. Wallace, and R. Goubran, “Impact of Image Resolution on Controlling Drones Using Remote VR Headset Visualization and a Cloud Architecture,” in 2025 IEEE Sensors Applications Symposium (SAS), Jul. 2025, pp. 1–6.
Link to Paper
T. Sloan, B. Wallace, and R. Goubran, “Drone-Based Indoor Mapping for Augmented Indoor 3D Modeling Using Neural Simultaneous Localization And Mapping (SLAM),” in IEEE International Conference on Consumer Electronics (ICCE 2026), Feb. 2026, pp. 1–4. ICCE 2026.
A. Laghai B. Wallace, K. C. Fraser, M. Kunz, F. Knoefel, R. Goubran, S. Shafiyan, N. Thomas, “Preliminary Results for Measurement of Eye Fixation and Speech to Identify Cognitive Decline” accepted at IEEE Medical Measurement and Applications Symposium (MeMeA 2025), 2025
M. Kunz, K. Fraser, B. Wallace, F. Knoefel, R. Goubran, S. Shafiyan, N. Thomas “Addressing Age Bias in the Application of Appearance-Based Gaze-Tracking for Older Adults”, IEEE/CVF Winter Conference on Applications of Computer Vision, 2025.
(Best Paper Award)
T. Sloan, B. Wallace, R. Goubran, “System for Drone Based Indoor Mapping for Augmented Reality” accepted at 2025 IEEE International Instrumentation Measurement Technology Conference (I2MTC), 2025
Lochbihler, Aidan “Methods for Classifying Driver Engagement in Autonomous Vehicles Using Physiological Sensors.” MASc diss., Carleton University, 2024.
Link to Thesis
Boulay, Emma “Eye-Tracking and Speech Analysis Measurement and Synchronization for Cognitive Assessment.” MASc diss., Carleton University, 2024.
Link to Thesis
Select Elhajjar, Diane “A Confidence Framework for Heart Rate Estimation in Video Magnification.” MASc diss., Carleton University, 2023. Elhajjar, Diane “A Confidence Framework for Heart Rate Estimation in Video Magnification.” MASc diss., Carleton University, 2023.
Link to Thesis
J. Valdes, Z. Cook, J. Wang, B. Wallace, B. Laska, J. Green, R. Goubran, P. Xi, “Human Activity Understanding through Explainable Audio-Visual Features”, IEEE Sensors Letters, 2024
Link to NRC Link to IEEE
Aidan Lochbihler, Bruce Wallace, Kathleen Van Benthem, Chris Herdman, Kirsten Brightman, Will Sloan, Rafik Goubran, Frank Knoefel, Shawn Marshall, Metrics in a Dynamic Gaze Environment, IEEE International Symposium on Medical Measurements (MeMeA) 2024, 2024
Link to Paper
A. Lochbihler, B. Wallace, K. Van Benthem, C. Herdman, W. Sloan, K. Brightman, F. Knoefel, S. Marshall, R. Goubran , “Multi-Class Gaze Detection in a Dynamic Environment” 2024 IEEE International Instrumentation Measurement Technology Conference (I2MTC), 2024
Link to Paper