NRC Canada

NRC Canada
Project 1: AI-enabled cough detection and multimodal contactless vital signs monitoring
2020 – 2021
Project goals:
- AI-enabled cough diagnostics: Cough is a symptom and mechanism for COVID-19 and viral spread. This project aims to distinguish cough types (dry, wet, wheeze and whooping) with data-driven approaches on previously collected cough data. Collaborating with the NRC team to integrate the models within a system for clinical validations. The COVID-19 cough will be explored to understand if there are unique features. The team will collaborate with other research organizations to obtain relevant data.
- Multimodal contactless vital signs monitoring: Thermal and RGB imaging has the potential to be used for non-contact assessment of vital signs (heart rate and respiration rate) through measurement of small changes in temperature or skin colour. The team has prior experience using thermal and RGB cameras within residential settings and will apply this to public space applications. The team will compare the performance of the cameras individually and in combination using existing datasets.
PI: Rafik Goubran
F. Knoefel, B. Wallace, N. Thomas, H. Sveistrup, R. Goubran, and C. Laurin, “Supportive Smart Homes: Their Role in Aging in Place”, Switzerland: Springer Nature, 2023
Link to Publisher Page Also available on Indigo Amazon Barnes and Noble MacOdrum Library
B. Wallace, F. Knoefel, R. Goubran, H. Sveistrup, and N. Thomas “Technology Enabling Aging in Place – The Supportive Smart Home,” IEEE Instrumentation & Measurement Magazine, 2023.
Link to Paper
M. Cohen-McFarlane, F., Hassan, P. Xi, B. Wallace, R. Goubran, F. Knoefel, “Impact of face covering models on respiratory sound classification applications” 2022 IEEE Sensors Applications Symposium (SAS), 2022.
Link to Paper
Yassin Kassab, L., Law, A., Wallace, B., Larivière-Chartier, J., Goubran, R. Knoefel, F., “Effects of Lighting and Window Length on Heart Rate Assessment through Video Magnification” 2022 IEEE Sensors Applications Symposium (SAS), 2022
Link to Paper
K. Habashy, J. Valdes, M. Cohen-McFarlane, F., P. Xi, B. Wallace, R. Goubran, F. Knoefel, “Cough Classification Using Audio Spectrogram Transformer” 2022 IEEE Sensors Applications Symposium (SAS), 2022
Link to Paper
M. Cohen-McFarlane, B. Wallace, P. Xi, R. Goubran, F. Knoefel, “Feasibility analysis of the fusion of pressure sensors and audio measurements for respiratory evaluations”, 2022 IEEE International Symposium on Medical Measurements and Applications (MeMeA), 2022.
Link to Paper
Yassin Kassab, L., Law, A., Wallace, B., Larivière-Chartier, J., Goubran, R. Knoefel, F., “The Effect of Noise on Contactless Heart Rate Measurement using Video Magnification”, 2022 IEEE International Instrumentation Measurement Technology Conference (I2MTC), 2022.
Link to paper
Cohen-MacFarlane, M “Human Respiratory Sound Classification for Remote Health Monitoring Applications”, PhD Thesis, Carleton University, 2022.
Link to paper
Yassin Kassab, L “Heart Rate Detection using Video Magnification: Impact of Algorithmic Parameters and Noise”, M.A.Sc. Thesis, Carleton University, 2022.
Link to paper
M. Mozafari, A. Law, J. Green, and R. Goubran, “Respiration Rate Estimation from Thermal Video of Masked and Unmasked Individuals Using Tensor Decomposition,” 2022 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), 2022.
Link to paper
M. Mozafari, A. Law, S. Béni Tchoudem Djouaka, J. Green, and R. Goubran, “Comparison of Blind Source Separation for Respiration Rate from Depth Camera,”2022 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), 2022.
Link to paper
B. Wallace, L. Y. Kassab, A. Law, R. Goubran, and F. Knoefel, “Contactless Remote Assessment of Heart Rate and Respiration Rate using Video Magnification,” IEEE Instrumentation & Measurement Magazine, no. Feb, p. 21, 2022.
Link to paper
Project 2: Integrated Decision Support for Health and Safety
2021 – 2024
Project goals: Healthy and safe aging in place requires a continuous assessment of well-being. Automating this assessment is a cost-effective solution that reduces the burden on family members and caregivers. This project proposes deploying ambient sensors in the home and using an integrated decision support system to combine the information from these sensors and assess the health and well-being of the home occupant. The system will monitor cough, vital signs (heart rate, breathing rate) and daily activities using data analysis, deep learning and machine learning methods. The result is an integrated decision support software system that can detect any decline in health conditions, help in the early detection of diseases and enable early intervention. The project will lead to a cost-effective approach to enable aging in place by providing high-quality healthcare, reducing the burden on family members, and reducing the need for long term care, in support of the NRC AiP program.
PI: Rafik Goubran
Publications
B. Laska, P. Xi, J. Valdés, B. Wallace, J. Green, R. Goubran, F. Knoefel, “Coughprint: Distilled Cough Representations from Speech Foundation Model Embeddings”, in IEEE Transactions on Instrumentation and Measurement, 2025
B. Laska, B. Wallace, R. Goubran, F. Knoefel, “Environment-Compensated Gas Sensor Time-Series Analysis for Tracking Food Spoilage” accepted at IEEE Medical Measurement and Applications Symposium (MeMeA 2025), 2025
Select Elhajjar, Diane “A Confidence Framework for Heart Rate Estimation in Video Magnification.” MASc diss., Carleton University, 2023. Elhajjar, Diane “A Confidence Framework for Heart Rate Estimation in Video Magnification.” MASc diss., Carleton University, 2023.
Link to Thesis
J. Valdes, Z. Cook, J. Wang, B. Wallace, B. Laska, J. Green, R. Goubran, P. Xi, “Human Activity Understanding through Explainable Audio-Visual Features”, IEEE Sensors Letters, 2024
Link to NRC Link to IEEE
Brady Laska, Pengcheng Xi, Julio Valdes, Bruce Wallace, Rafik Goubran, Zero-shot Multi-task Cough Sound Analysis with Speech Foundation Model Embeddings, IEEE International Symposium on Medical Measurements (MeMeA) 2024, 2024
Link to Paper
Saiful Huq, “Differentiation of Dry and Wet Cough Sounds using A Deep Learning Model and Data Augmentation”, M.A.Sc. Thesis Carleton University, 2023.
Link to Thesis
Mahya Shahmohammadimehrjardi, Bruce Wallace, Adrian D. C. Chan, Rafik Goubran , Pengcheng Xi, Julio J. Valdes , “Multi-Level Method for Sound Source Location Measurement” 2024 IEEE International Instrumentation Measurement Technology Conference (I2MTC), 2024
Link to Paper
Brady Laska, Julio J. Valdés, Pengcheng Xi, Rafik Goubran, Bruce Wallace, Madison Cohen-McFarlane, Frank Knoefel, “Cough Sound Analysis using Vocal Tract Models” 2024 IEEE International Instrumentation Measurement Technology Conference (I2MTC), 2024
Link to Paper
D. Elhajjar, B. Wallace, A. Law, R. Goubran, F. Knoefel, “Machine Learning Assessment of Heart Rate Confidence from Video Magnification “, 23rd IEEE International Conference on Bioinformatics and Bioengineering (BIBE), 2023
Link to Paper
R. Goubran, F. Knoefel, B. Wallace, N. Thomas, C. Herdman K. van Benthem, H. Sveistrup, K. Fraser, M. Kunz, P. Xi, A. Law, J. Keillor, “AGE-WELL SAM3 collaborative projects with NRC Aging-in-Place program”, AGE-WELL AGM, 2023.
S. Huq, P. Xi, R. Goubran, J. J. Valdés, F. Knoefel and J. R. Green, “Data Augmentation using Reverb and Noise in Deep Learning Implementation of Cough Classification,” 2023 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Jeju, Korea, Republic of, 2023, pp. 1-6.
Link to Paper
F. Knoefel, B. Wallace, N. Thomas, H. Sveistrup, R. Goubran, and C. Laurin, “Supportive Smart Homes: Their Role in Aging in Place”, Switzerland: Springer Nature, 2023
Link to Publisher Page Also available on Indigo Amazon Barnes and Noble MacOdrum Library
Project 3: Speech and eye-movements analysis for the remote early detection of diseases associated with aging
2022 – 2025
Project goals: Early identification of cognitive decline allows for earlier intervention with appropriate care so that entry to long term care can be delayed. This project explores two non-invasive assessments (eye-tracking and speech patterns) that have potential for cognitive assessment. Specifically, the project will design a system to capture voice and eye-gaze data during tasks, with the goal of detecting speech and oculomotor abnormalities associated with cognitive decline. It will combine the two modalities and leverage multimodal analysis techniques to generate more sensitive predictions. The project will analyze combinations of tasks to achieve the assessment. The project will collect longitudinal data, to allow intra-subject analysis in addition to cross-sectional analysis to validate the performance of the system. The project will lead to a more cost-effective approach for assessment that could be done at home or remotely and that is an alternative to more expensive or invasive diagnostic testing currently being done.
PI: Frank Knoefel
Publications
Select A. Laghai, S. Shafiyan, N. Thomas, M. Kunz, K. Fraser, B. Wallace, R. Goubran, F. Knoefel, “Can Gaze–Speech Coupling in Reading Help Clinicians Detect Cognitive Decline Remotely?” ISG 2026 A. Laghai, S. Shafiyan, N. Thomas, M. Kunz, K. Fraser, B. Wallace, R. Goubran, F. Knoefel, “Can Gaze–Speech Coupling in Reading Help Clinicians Detect Cognitive Decline Remotely?” ISG 2026
Select Sina Shafiyan, Neil Thomas, Manuela Kunz, Kathleen Fraser, Bruce Wallace, Rafik Goubran, Amir Laghai, Frank Knoefel, “Saccadic Markers of Cognitive Decline: Preliminary Findings from a Multimodal Eye Movement and Speech Assessment”, AGEWELL AGM, 2025 Sina Shafiyan, Neil Thomas, Manuela Kunz, Kathleen Fraser, Bruce Wallace, Rafik Goubran, Amir Laghai, Frank Knoefel, “Saccadic Markers of Cognitive Decline: Preliminary Findings from a Multimodal Eye Movement and Speech Assessment”, AGEWELL AGM, 2025
Best Poster Runner Up
S. Shafiyan, K. Fraser, F. Knoefel, N. Thomas, M. Kunz, B. Wallace, R. Goubran, A.a Zumbansen, “Revisiting the Cookie Theft Picture for Cognitive Impairment: Assessing Its Relevance for Discourse Analysis After Four Decades”, accepted at Alzheimer’s Association International Conference (AAIC), 2025.
A. Laghai B. Wallace, K. C. Fraser, M. Kunz, F. Knoefel, R. Goubran, S. Shafiyan, N. Thomas, “Preliminary Results for Measurement of Eye Fixation and Speech to Identify Cognitive Decline” accepted at IEEE Medical Measurement and Applications Symposium (MeMeA 2025), 2025
M. Kunz, K. Fraser, B. Wallace, F. Knoefel, R. Goubran, S. Shafiyan, N. Thomas “Addressing Age Bias in the Application of Appearance-Based Gaze-Tracking for Older Adults”, IEEE/CVF Winter Conference on Applications of Computer Vision, 2025.
(Best Paper Award)
Boulay, Emma “Eye-Tracking and Speech Analysis Measurement and Synchronization for Cognitive Assessment.” MASc diss., Carleton University, 2024.
Link to Thesis
Select E. Boulay, B. Wallace, Kathleen C Fraser, Manuela Kunz, Rafik Goubran, F. Knoefel , Neil Thomas, “Improving Synchronization of Eye Fixation and Saccade Measurements with Speech Recognition for Cognitive Assessment”, 2024 Sensor Applications Symposium (SAS), 2024 E. Boulay, B. Wallace, Kathleen C Fraser, Manuela Kunz, Rafik Goubran, F. Knoefel , Neil Thomas, “Improving Synchronization of Eye Fixation and Saccade Measurements with Speech Recognition for Cognitive Assessment”, 2024 Sensor Applications Symposium (SAS), 2024
Link to Paper
Emma Boulay, Bruce Wallace, Kathleen C. Fraser, Manuela Kunz, Rafik Goubran, Frank Knoefel, Neil Thomas, “A Cost-Effective Webcam Eye-Tracking Algorithm for Robust Classification of Fixations and Saccades” 2024 IEEE International Instrumentation Measurement Technology Conference (I2MTC), 2024
Link to Paper
R. Goubran, F. Knoefel, B. Wallace, N. Thomas, C. Herdman K. van Benthem, H. Sveistrup, K. Fraser, M. Kunz, P. Xi, A. Law, J. Keillor, “AGE-WELL SAM3 collaborative projects with NRC Aging-in-Place program”, AGE-WELL AGM, 2023.
M. Kunz, A. Syed, K. Fraser, B. Wallace, R. Goubran, F. Knoefel, N. Thomas, “Reducing Fixation Error Due to Natural Head Movement in a Webcam-based Eye-tracking Method” 2023 IEEE Sensors Applications Symposium (SAS), 2023.
Link to Paper
E. Boulay, B. Wallace, K. Fraser, M. Kunz, F. Knoefel, R. Goubran, N. Thomas, “Design and Validation of a System to Synchronize Speech Recognition and Eye-Tracking Measurements” 2023 IEEE Sensors Applications Symposium (SAS), 2023.
Link to Paper
Project 4: Sensor networks for safe and engaged mature drivers (SENSE-MD)
2022 – 2025
Project goals: Aging in place has many benefits. Older Canadians often need to drive in order to take advantage of these benefits as a consequence of Canada’s climate and geography. Aging brings natural and illness-related health declines putting mature drivers at risk for driving accidents. Furthermore, the unplanned cessation of driving causes isolation, leading to increased risk of dementia, poorer physical and mental health, and reduced ability to engage in social and physical activities. This project aims to provide a solution for a key missing element in the current driver assessment regime: knowledge of changes in risk and driving capacity based on valuable data from onboard vehicle sensors. Clinical assessments are infrequent and only indirectly measure driving skills, increasing risks for premature driving cessation and isolation. The SENSE-MD project will offer a technology-based solution that delivers information to the driver regarding changes in risks. This information can also be shared with families and caregivers as appropriate.
See the project web page. www.sense-md.ca
PI: Chris Herdman
K. Van Benthem, B. Wallace, L. McCauley, J. Keillor, S. Marshall, F. Knoefel, T. Friedman, and C. Herdman, “Profiles of Mature Drivers and Their Trust in Telematics‑Based Safety Technologies”, ISG 2026
L. McCauley, K. Van Benthem, B. Wallace, C. Herdman, J. Keillor, F. Knoefel, S. Marshall, “Effective Communication of Driving Feedback: Principles and Strategies for Empowering Older Adults”, ISG 2026
McCauley, L., Benthem, K. V., Herdman, C., Wallace, B., Keillor, J., Goubran, R., Knoefel, F., & Marshall, SM, “Communicating increased driving risk: A study of mature driver expectations”, accepted at Alzheimer’s Association International Conference (AAIC), 2025.
Nasr, M. S. E., Masson, P., Wallace, B., A., Benthem, K. V., Herdman, C., Keillor, J., Goubran, R., Knoefel, F., & Marshall, SM. “Identifying Mature Driver Risk from Naturalistic Driving”, accepted at Alzheimer’s Association International Conference (AAIC), 2025.
M. Saif El Nasr, P. Masson, B. Wallace, A. Abarghooei, K. Van Benthem, C. Herdman, J. Keillor, R. Goubran, F. Knoefel, S. Marshall, “Investigating the Links between Mature Driver Health, Collision Risk, and Vignette-based Telematic Measurements” accepted at IEEE Medical Measurement and Applications Symposium (MeMeA 2025), 2025
Lochbihler, Aidan “Methods for Classifying Driver Engagement in Autonomous Vehicles Using Physiological Sensors.” MASc diss., Carleton University, 2024.
Link to Thesis
New Study: Staying Alert in Autopilot: The Effects of Trust in Automation and Attentional Capacity on Situation Awareness in Senior Drivers
We are recruiting participants for research exploring how trust in automation and attentional capacity affect senior driver safety. If you are interested please see the …
Volunteers needed for SENSE-MD: Survey for Mature Driver
We are inviting Canadian residents aged 55 or older who currently hold or have held a valid driver’s license within the past year to participate …
Bruce Wallace, Philippe Masson, Jonathan Ojangole, Kathleen Van Benthem, Chris Herdman, Jocelyn Keillor, Rafik Goubran, Frank Knoefel, Shawn Marshall, Assessing Driving Risk Indicators from Large Driving Data Sets, IEEE International Symposium on Medical Measurements (MeMeA) 2024, 2024
Link to Paper
Aidan Lochbihler, Bruce Wallace, Kathleen Van Benthem, Chris Herdman, Kirsten Brightman, Will Sloan, Rafik Goubran, Frank Knoefel, Shawn Marshall, Metrics in a Dynamic Gaze Environment, IEEE International Symposium on Medical Measurements (MeMeA) 2024, 2024
Link to Paper
Bruce Wallace, Kathleen Van Benthem, Jocelyn Keillor, Chris Herdman, Rafik Goubran, Frank Knoefel, Supporting Safe Driving for Older Adults – at a Crossroads with ADAS, IEEE Instrumentation Measurements Magazine, 2024
Link to paper
A. Lochbihler, B. Wallace, K. Van Benthem, C. Herdman, W. Sloan, K. Brightman, F. Knoefel, S. Marshall, R. Goubran , “Multi-Class Gaze Detection in a Dynamic Environment” 2024 IEEE International Instrumentation Measurement Technology Conference (I2MTC), 2024
Link to Paper
Project 5: SAM3 SME Support for Aging in Place Technology CTO
2023 –
Project goals: The objective of the project is to accelerate the growth of Canadian SMEs in the AgeTech ecosystem by providing services to test Aging in Place technologies. The Organization will utilize the specialized expertise, facilities, and equipment of the Sensors and Analytics for Monitoring Mobility and Memory (SAM3) Innovation Hub, founded by Carleton University, the Bruyère Research Institute and the AGE-WELL National Centre of Excellence.
See the CTO web page https://carleton.ca/sam3/nrc-irapcto/
News
Sensor networks for safe and engaged mature drivers (SENSE-MD)
Exciting new SAM3 project in collaboration with NRC. The project includes a multi-disciplinary team of driving researchers including Bruyere, Carleton Systems Engineering and Cognitive Science …
