{"id":13571,"date":"2021-10-13T16:12:43","date_gmt":"2021-10-13T20:12:43","guid":{"rendered":"https:\/\/carleton.ca\/cognitivescience\/?p=13571"},"modified":"2021-10-13T16:14:18","modified_gmt":"2021-10-13T20:14:18","slug":"colloquium-high-dimensional-vector-spaces-as-the-architecture-of-cognition","status":"publish","type":"post","link":"https:\/\/carleton.ca\/cognitivescience\/2021\/colloquium-high-dimensional-vector-spaces-as-the-architecture-of-cognition\/","title":{"rendered":"Colloquium: High-Dimensional Vector Spaces As the Architecture of Cognition"},"content":{"rendered":"<p style=\"margin: 0px; padding: 0px 0px 25px; color: #191919; text-transform: none; line-height: 1.7; text-indent: 0px; letter-spacing: normal; font-family: 'Gotham Narrow SSm A', 'Gotham Narrow SSm B'; font-size: 1.5rem; font-style: normal; font-weight: 300; word-spacing: 0px; white-space: normal; box-sizing: border-box; orphans: 2; widows: 2; background-color: #ffffff; overflow-wrap: break-word; font-variant-ligatures: normal; font-variant-caps: normal; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;\"><strong>Date:<\/strong>\u00a0Wednesday, Oct 20 2021 @03:30PM -04:30PM<\/p>\n<p style=\"margin: 0px; padding: 0px 0px 25px; color: #191919; text-transform: none; line-height: 1.7; text-indent: 0px; letter-spacing: normal; font-family: 'Gotham Narrow SSm A', 'Gotham Narrow SSm B'; font-size: 1.5rem; font-style: normal; font-weight: 300; word-spacing: 0px; white-space: normal; box-sizing: border-box; orphans: 2; widows: 2; background-color: #ffffff; overflow-wrap: break-word; font-variant-ligatures: normal; font-variant-caps: normal; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;\"><strong>Location:<\/strong>\u00a0Online<\/p>\n<p style=\"margin: 0px; padding: 0px 0px 25px; color: #191919; text-transform: none; line-height: 1.7; text-indent: 0px; letter-spacing: normal; font-family: 'Gotham Narrow SSm A', 'Gotham Narrow SSm B'; font-size: 1.5rem; font-style: normal; font-weight: 300; word-spacing: 0px; white-space: normal; box-sizing: border-box; orphans: 2; widows: 2; background-color: #ffffff; overflow-wrap: break-word; font-variant-ligatures: normal; font-variant-caps: normal; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;\"><strong>Title<\/strong>: High-Dimensional Vector Spaces As the Architecture of Cognition<\/p>\n<p style=\"margin: 0px; padding: 0px 0px 25px; color: #191919; text-transform: none; line-height: 1.7; text-indent: 0px; letter-spacing: normal; font-family: 'Gotham Narrow SSm A', 'Gotham Narrow SSm B'; font-size: 1.5rem; font-style: normal; font-weight: 300; word-spacing: 0px; white-space: normal; box-sizing: border-box; orphans: 2; widows: 2; background-color: #ffffff; overflow-wrap: break-word; font-variant-ligatures: normal; font-variant-caps: normal; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;\"><strong>Speaker:<\/strong>\u00a0M. Alex Kelly<\/p>\n<p style=\"margin: 0px; padding: 0px 0px 25px; color: #191919; text-transform: none; line-height: 1.7; text-indent: 0px; letter-spacing: normal; font-family: 'Gotham Narrow SSm A', 'Gotham Narrow SSm B'; font-size: 1.5rem; font-style: normal; font-weight: 300; word-spacing: 0px; white-space: normal; box-sizing: border-box; orphans: 2; widows: 2; background-color: #ffffff; overflow-wrap: break-word; font-variant-ligatures: normal; font-variant-caps: normal; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;\"><strong>Abstract:<\/strong><\/p>\n<p style=\"margin: 0px; padding: 0px 0px 25px; color: #191919; text-transform: none; line-height: 1.7; text-indent: 0px; letter-spacing: normal; font-family: 'Gotham Narrow SSm A', 'Gotham Narrow SSm B'; font-size: 1.5rem; font-style: normal; font-weight: 300; word-spacing: 0px; white-space: normal; box-sizing: border-box; orphans: 2; widows: 2; background-color: #ffffff; overflow-wrap: break-word; font-variant-ligatures: normal; font-variant-caps: normal; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;\">We demonstrate that the key components of cognitive architectures (declarative and procedural memory) and their key capabilities (learning, memory retrieval, probability judgment, and utility estimation) can be implemented as algebraic operations on vectors and tensors in a high-dimensional space using a distributional semantics model. High-dimensional vector spaces underlie the success of modern machine learning techniques based on deep learning. However, while neural networks have an impressive ability to process data to find patterns, they do not typically model high-level cognition, and it is often unclear how they work. Symbolic cognitive architectures can capture the complexities of high-level cognition and provide human-readable, explainable models, but scale poorly to naturalistic, non-symbolic, or big data. Vector-symbolic architectures, where symbols are represented as vectors, bridge the gap between the two approaches.<\/p>\n<p style=\"margin: 0px; padding: 0px 0px 25px; color: #191919; text-transform: none; line-height: 1.7; text-indent: 0px; letter-spacing: normal; font-family: 'Gotham Narrow SSm A', 'Gotham Narrow SSm B'; font-size: 1.5rem; font-style: normal; font-weight: 300; word-spacing: 0px; white-space: normal; box-sizing: border-box; orphans: 2; widows: 2; background-color: #ffffff; overflow-wrap: break-word; font-variant-ligatures: normal; font-variant-caps: normal; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;\">We posit that cognitive architectures, if implemented in a vector-space model, represent a useful, explanatory model of the internal representations of otherwise opaque neural architectures. Our proposed model, Holographic Declarative Memory (HDM), is a vector-space model based on distributional semantics. HDM accounts for primacy and recency effects in free recall, the fan effect in recognition, probability judgments, and human performance on an iterated decision task. HDM provides a flexible, scalable alternative to symbolic cognitive architectures at a level of description that bridges symbolic, quantum, and neural models of cognition.<\/p>\n<p style=\"margin: 0px; padding: 0px 0px 25px; color: #191919; text-transform: none; line-height: 1.7; text-indent: 0px; letter-spacing: normal; font-family: 'Gotham Narrow SSm A', 'Gotham Narrow SSm B'; font-size: 1.5rem; font-style: normal; font-weight: 300; word-spacing: 0px; white-space: normal; box-sizing: border-box; orphans: 2; widows: 2; background-color: #ffffff; overflow-wrap: break-word; font-variant-ligatures: normal; font-variant-caps: normal; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;\"><strong>Speaker\u2019s bio:<\/strong><\/p>\n<p style=\"margin: 0px; padding: 0px 0px 25px; color: #191919; text-transform: none; line-height: 1.7; text-indent: 0px; letter-spacing: normal; font-family: 'Gotham Narrow SSm A', 'Gotham Narrow SSm B'; font-size: 1.5rem; font-style: normal; font-weight: 300; word-spacing: 0px; white-space: normal; box-sizing: border-box; orphans: 2; widows: 2; background-color: #ffffff; overflow-wrap: break-word; font-variant-ligatures: normal; font-variant-caps: normal; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;\">Alex Kelly is an Assistant Professor of Cognitive Science at Carleton University\u00a0interested in human memory, natural language, and minds both natural and artificial. Dr. Kelly has previously worked as an Assistant Professor in Computer Science at Bucknell University, a Researcher at Penn State\u2019s College of Information Sciences and Technology, and has a Ph.D. in Cognitive Science from Carleton University, and an M.Sc. and B.Cmp.Hons. from Queen\u2019s University\u2019s School of Computing.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Date:\u00a0Wednesday, Oct 20 2021 @03:30PM -04:30PM Location:\u00a0Online Title: High-Dimensional Vector Spaces As the Architecture of Cognition Speaker:\u00a0M. Alex Kelly Abstract: We demonstrate that the key components of cognitive architectures (declarative and procedural memory) and their key capabilities (learning, memory retrieval, probability judgment, and utility estimation) can be implemented as algebraic operations on vectors and tensors [&hellip;]<\/p>\n","protected":false},"author":31,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_relevanssi_hide_post":"","_relevanssi_hide_content":"","_relevanssi_pin_for_all":"","_relevanssi_pin_keywords":"","_relevanssi_unpin_keywords":"","_relevanssi_related_keywords":"","_relevanssi_related_include_ids":"","_relevanssi_related_exclude_ids":"","_relevanssi_related_no_append":"","_relevanssi_related_not_related":"","_relevanssi_related_posts":"","_relevanssi_noindex_reason":"","_mi_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":"","_links_to":"","_links_to_target":""},"categories":[1],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.2 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Colloquium: High-Dimensional Vector Spaces As the Architecture of Cognition - Department of Cognitive Science<\/title>\n<meta name=\"description\" content=\"Date:\u00a0Wednesday, Oct 20 2021 @03:30PM -04:30PM Location:\u00a0Online Title: High-Dimensional Vector Spaces As the Architecture of Cognition Speaker:\u00a0M. Alex\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/carleton.ca\/cognitivescience\/2021\/colloquium-high-dimensional-vector-spaces-as-the-architecture-of-cognition\/\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"uzmakhan\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/carleton.ca\/cognitivescience\/2021\/colloquium-high-dimensional-vector-spaces-as-the-architecture-of-cognition\/\",\"url\":\"https:\/\/carleton.ca\/cognitivescience\/2021\/colloquium-high-dimensional-vector-spaces-as-the-architecture-of-cognition\/\",\"name\":\"Colloquium: High-Dimensional Vector Spaces As the Architecture of Cognition - Department of Cognitive Science\",\"isPartOf\":{\"@id\":\"https:\/\/carleton.ca\/cognitivescience\/#website\"},\"datePublished\":\"2021-10-13T20:12:43+00:00\",\"dateModified\":\"2021-10-13T20:14:18+00:00\",\"author\":{\"@id\":\"https:\/\/carleton.ca\/cognitivescience\/#\/schema\/person\/ac0daaa91d08b0b6535c91d49649671c\"},\"description\":\"Date:\u00a0Wednesday, Oct 20 2021 @03:30PM -04:30PM Location:\u00a0Online Title: High-Dimensional Vector Spaces As the Architecture of Cognition Speaker:\u00a0M. Alex\",\"breadcrumb\":{\"@id\":\"https:\/\/carleton.ca\/cognitivescience\/2021\/colloquium-high-dimensional-vector-spaces-as-the-architecture-of-cognition\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/carleton.ca\/cognitivescience\/2021\/colloquium-high-dimensional-vector-spaces-as-the-architecture-of-cognition\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/carleton.ca\/cognitivescience\/2021\/colloquium-high-dimensional-vector-spaces-as-the-architecture-of-cognition\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/carleton.ca\/cognitivescience\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"News\",\"item\":\"https:\/\/carleton.ca\/cognitivescience\/category\/news\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Colloquium: High-Dimensional Vector Spaces As the Architecture of Cognition\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/carleton.ca\/cognitivescience\/#website\",\"url\":\"https:\/\/carleton.ca\/cognitivescience\/\",\"name\":\"Department of Cognitive Science\",\"description\":\"Carleton University\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/carleton.ca\/cognitivescience\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/carleton.ca\/cognitivescience\/#\/schema\/person\/ac0daaa91d08b0b6535c91d49649671c\",\"name\":\"uzmakhan\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/carleton.ca\/cognitivescience\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/52617476b952e25774b2c33a6291f8d9?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/52617476b952e25774b2c33a6291f8d9?s=96&d=mm&r=g\",\"caption\":\"uzmakhan\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Colloquium: High-Dimensional Vector Spaces As the Architecture of Cognition - Department of Cognitive Science","description":"Date:\u00a0Wednesday, Oct 20 2021 @03:30PM -04:30PM Location:\u00a0Online Title: High-Dimensional Vector Spaces As the Architecture of Cognition Speaker:\u00a0M. Alex","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/carleton.ca\/cognitivescience\/2021\/colloquium-high-dimensional-vector-spaces-as-the-architecture-of-cognition\/","twitter_misc":{"Written by":"uzmakhan","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/carleton.ca\/cognitivescience\/2021\/colloquium-high-dimensional-vector-spaces-as-the-architecture-of-cognition\/","url":"https:\/\/carleton.ca\/cognitivescience\/2021\/colloquium-high-dimensional-vector-spaces-as-the-architecture-of-cognition\/","name":"Colloquium: High-Dimensional Vector Spaces As the Architecture of Cognition - Department of Cognitive Science","isPartOf":{"@id":"https:\/\/carleton.ca\/cognitivescience\/#website"},"datePublished":"2021-10-13T20:12:43+00:00","dateModified":"2021-10-13T20:14:18+00:00","author":{"@id":"https:\/\/carleton.ca\/cognitivescience\/#\/schema\/person\/ac0daaa91d08b0b6535c91d49649671c"},"description":"Date:\u00a0Wednesday, Oct 20 2021 @03:30PM -04:30PM Location:\u00a0Online Title: High-Dimensional Vector Spaces As the Architecture of Cognition Speaker:\u00a0M. Alex","breadcrumb":{"@id":"https:\/\/carleton.ca\/cognitivescience\/2021\/colloquium-high-dimensional-vector-spaces-as-the-architecture-of-cognition\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/carleton.ca\/cognitivescience\/2021\/colloquium-high-dimensional-vector-spaces-as-the-architecture-of-cognition\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/carleton.ca\/cognitivescience\/2021\/colloquium-high-dimensional-vector-spaces-as-the-architecture-of-cognition\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/carleton.ca\/cognitivescience\/"},{"@type":"ListItem","position":2,"name":"News","item":"https:\/\/carleton.ca\/cognitivescience\/category\/news\/"},{"@type":"ListItem","position":3,"name":"Colloquium: High-Dimensional Vector Spaces As the Architecture of Cognition"}]},{"@type":"WebSite","@id":"https:\/\/carleton.ca\/cognitivescience\/#website","url":"https:\/\/carleton.ca\/cognitivescience\/","name":"Department of Cognitive Science","description":"Carleton University","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/carleton.ca\/cognitivescience\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/carleton.ca\/cognitivescience\/#\/schema\/person\/ac0daaa91d08b0b6535c91d49649671c","name":"uzmakhan","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/carleton.ca\/cognitivescience\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/52617476b952e25774b2c33a6291f8d9?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/52617476b952e25774b2c33a6291f8d9?s=96&d=mm&r=g","caption":"uzmakhan"}}]}},"acf":{"Post Thumbnail Icon":"","Post Thumbnail":{"ID":13049,"id":13049,"title":"Alex Kelly2","filename":"Alex-Kelly2.jpg","filesize":93077,"url":"https:\/\/carleton.ca\/cognitivescience\/wp-content\/uploads\/Alex-Kelly2.jpg","link":"https:\/\/carleton.ca\/cognitivescience\/people\/mary-kelly\/alex-kelly2\/","alt":"","author":"19","description":"","caption":"","name":"alex-kelly2","status":"inherit","uploaded_to":13050,"date":"2021-04-12 12:59:45","modified":"2021-04-12 13:03:27","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/carleton.ca\/cognitivescience\/wp\/wp-includes\/images\/media\/default.png","width":400,"height":470,"sizes":{"thumbnail":"https:\/\/carleton.ca\/cognitivescience\/wp-content\/uploads\/Alex-Kelly2-160x188.jpg","thumbnail-width":160,"thumbnail-height":188,"medium":"https:\/\/carleton.ca\/cognitivescience\/wp-content\/uploads\/Alex-Kelly2-240x282.jpg","medium-width":240,"medium-height":282,"medium_large":"https:\/\/carleton.ca\/cognitivescience\/wp-content\/uploads\/Alex-Kelly2.jpg","medium_large-width":400,"medium_large-height":470,"large":"https:\/\/carleton.ca\/cognitivescience\/wp-content\/uploads\/Alex-Kelly2.jpg","large-width":400,"large-height":470,"gallery-thumb":"https:\/\/carleton.ca\/cognitivescience\/wp-content\/uploads\/Alex-Kelly2-300x230.jpg","gallery-thumb-width":300,"gallery-thumb-height":230,"1536x1536":"https:\/\/carleton.ca\/cognitivescience\/wp-content\/uploads\/Alex-Kelly2.jpg","1536x1536-width":400,"1536x1536-height":470,"2048x2048":"https:\/\/carleton.ca\/cognitivescience\/wp-content\/uploads\/Alex-Kelly2.jpg","2048x2048-width":400,"2048x2048-height":470,"banner":"https:\/\/carleton.ca\/cognitivescience\/wp-content\/uploads\/Alex-Kelly2.jpg","banner-width":400,"banner-height":470,"people":"https:\/\/carleton.ca\/cognitivescience\/wp-content\/uploads\/Alex-Kelly2-200x200.jpg","people-width":200,"people-height":200,"post-thumb":"https:\/\/carleton.ca\/cognitivescience\/wp-content\/uploads\/Alex-Kelly2-300x230.jpg","post-thumb-width":300,"post-thumb-height":230,"rotator-image":"https:\/\/carleton.ca\/cognitivescience\/wp-content\/uploads\/Alex-Kelly2.jpg","rotator-image-width":400,"rotator-image-height":470,"video-thumb":"https:\/\/carleton.ca\/cognitivescience\/wp-content\/uploads\/Alex-Kelly2-360x423.jpg","video-thumb-width":360,"video-thumb-height":423,"cms-newsletter-image":"https:\/\/carleton.ca\/cognitivescience\/wp-content\/uploads\/Alex-Kelly2-200x235.jpg","cms-newsletter-image-width":200,"cms-newsletter-image-height":235}}},"_links":{"self":[{"href":"https:\/\/carleton.ca\/cognitivescience\/wp-json\/wp\/v2\/posts\/13571"}],"collection":[{"href":"https:\/\/carleton.ca\/cognitivescience\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/carleton.ca\/cognitivescience\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/carleton.ca\/cognitivescience\/wp-json\/wp\/v2\/users\/31"}],"replies":[{"embeddable":true,"href":"https:\/\/carleton.ca\/cognitivescience\/wp-json\/wp\/v2\/comments?post=13571"}],"version-history":[{"count":2,"href":"https:\/\/carleton.ca\/cognitivescience\/wp-json\/wp\/v2\/posts\/13571\/revisions"}],"predecessor-version":[{"id":13573,"href":"https:\/\/carleton.ca\/cognitivescience\/wp-json\/wp\/v2\/posts\/13571\/revisions\/13573"}],"wp:attachment":[{"href":"https:\/\/carleton.ca\/cognitivescience\/wp-json\/wp\/v2\/media?parent=13571"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/carleton.ca\/cognitivescience\/wp-json\/wp\/v2\/categories?post=13571"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/carleton.ca\/cognitivescience\/wp-json\/wp\/v2\/tags?post=13571"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}