{"id":158,"date":"2023-10-24T11:40:26","date_gmt":"2023-10-24T15:40:26","guid":{"rendered":"https:\/\/carleton.ca\/xlab\/?p=158"},"modified":"2023-10-24T11:40:26","modified_gmt":"2023-10-24T15:40:26","slug":"using-simon-willisons-llm-package-to-extract-a-knowledge-graph","status":"publish","type":"post","link":"https:\/\/carleton.ca\/xlab\/2023\/using-simon-willisons-llm-package-to-extract-a-knowledge-graph\/","title":{"rendered":"Using Simon Willison’s LLM Package to Extract a Knowledge Graph"},"content":{"rendered":"

Simon Willison’s LLM package<\/a> is a lovely little command line utility that allows you to work with many different large language models. In this post, we use LLM to extract a knowledge graph from a mermaid diagram sketch.<\/p>\n

1. Sketch out the basics of your knowledge graph. On paper – yes, on paper! It’s quicker that way. What kinds of entities do you have? What are their properties? What are the relationships between the entities, and what are their properties? Once you have this sketched, you can translate the sketch into the more formal language of an entity relation graph using the mermaid conventions.<\/a>
\nerDiagram
\nAUCTIONHOUSE ||--o{ ARTIFACT: auctions
\nAUCTIONHOUSE ||--o{ PERSON: sells_to
\nAUCTIONHOUSE ||--o{ MUSEUM: sells_to
\nMUSEUM{
\nstring name
\nstring city
\nstring country
\n}
\nAUCTIONHOUSE{
\nstring name
\nstring city
\nstring country
\n}
\n<\/code>
\nfor instance specifies some relationships between auction houses and artifacts, persons, and museums; then, we specify some of the properties of MUSEUM and AUCTIONHOUSE and so on.<\/p>\n

I write my diagram at https:\/\/mermaid.live\/edit\u00a0<\/a>so I can also see the result, making sure it conforms to my initial sketch:<\/p>\n

\"\"<\/div>\n

2. I install LLM into a new python environment. Assuming you’ve created your environment, at the terminal:<\/p>\n

$ pip install llm<\/code><\/p>\n

3. I install the llm-gpt4all plugin which makes a number of models optimized to run on consumer grade machines available:<\/p>\n

$llm install llm-gpt4all<\/code><\/p>\n

You can then see what’s available by running:<\/p>\n

$llm models list<\/code><\/p>\n

If you want to use any particular model, you just use the name from that list after the -m flag; the first time you use it, it will download the relevant model. Test it now:<\/p>\n

$llm -m orca-mini-7b '3 names for a pet cow'<\/code><\/p>\n

Now, for our purposes, we want to use that sketch of the ontology of the antiquities trade as the guide for the model. We want the model to do one thing, and one thing well: identify entities and their properties, and the relationships that we’ve already specified in the sketch. To do that, we’ll make a template file.<\/p>\n

4. Find the templates directory: $llm templates path<\/code> .\u00a0 Open your code or text editor of choice. Create an empty file called extract.yaml<\/code> and save it in that folder. We’re now going to define a system key, which will tell the model what kind of persona to adopt, and a prompt key which will tell it what to do. Here’s mine.<\/a> Notice you can use variables in your template; in mine, I have $input for the text being processed. Here’s more about templates and variables<\/a>; I no doubt could be more elegant here.<\/p>\n

5. Now that we have a model downloaded, and a template to guide it, we’ll run it against a file. We can grab webpages and feed them directly to the model using a combination of tools such as curl and Willison’s strip-tags utility, which would be really elegant. However, I already have a folder with the information I’m after on my machine. To feed a single file to the prompt we use the cat<\/code> command:<\/p>\n

$cat giacomo.txt | llm -m 4 -t extract > outputgraph.csv`<\/span><\/code><\/p>\n

That one-liner says take the text file called giacomo.txt<\/code> and run it through the GPT4 large language model using extract.yaml as the prompt and guide then write the output to outputgraph.csv<\/code>.<\/p>\n

We get:<\/p>\n


\n1. (\"Giacomo Medici\", \"sells_to\", \"Sotheby\u2019s London\")
\n2. (\"Sotheby\u2019s London\", \"auctions\", \"Onesimos kylix\")
\n3. (\"Hydra Gallery\", \"sells_to\", \"Sotheby\u2019s London\")
\n4. (\"Christian Boursaud\", \"works_with\", \"Giacomo Medici\")
\n5. (\"Giacomo Medici\", \"works_with\", \"Robert Hecht\")
\n6. (\"J. Paul Getty Museum\", \"buys\", \"Onesimos kylix\")
\n7. (\"Robert Hecht\", \"buys\", \"Euphronios (Sarpedon) krater\")
\n8. (\"Giacomo Medici\", \"sells_to\", \"J. Paul Getty Museum\")
\n9. (\"Giacomo Medici\", \"controls\", \"Hydra Gallery\")
\n10. (\"Giacomo Medici\", \"obtains_from\", \"Christian Boursaud\")
\n11. (\"Medici\", \"has_posession_of\", \"Euphronios (Sarpedon) krater\")
\n12. (\"Editions Services\", \"is_instance_of\", \"ORGANIZATION\")
\n13. (\"Giacomo Medici\", \"controls\", \"Editions Services\")
\n14. (\"Sotheby\u2019s\", \"auctions\", \"looted Apulian vases\")
\n15. (\"Sotheby\u2019s\", \"sells_to\", \"J. Paul Getty Museum\")
\n16. (\"Sotheby\u2019s\", \"sells_to\", \"Metropolitan Museum of Art\")
\n17. (\"Sotheby\u2019s\", \"sells_to\", \"Cleveland Museum of Art\")
\n18. (\"Sotheby\u2019s\", \"sells_to\", \"Boston Museum of Fine Arts\")
\n19. (\"Maurice Tempelsman\", \"buys_at\", \"Sotheby\u2019s\")
\n20. (\"Shelby White\", \"buys_at\", \"Sotheby\u2019s\")
\n21. (\"George Ortiz\", \"buys_at\", \"Sotheby\u2019s\")
\n22. (\"Jos\u00e9 Luis V\u00e1rez Fisa\", \"buys_at\", \"Sotheby\u2019s\")
\n23. (\"Lawrence Fleischman\", \"buys_at\", \"Sotheby\u2019s\")
\n24. (\"Giacomo Medici\", \"sells_to\", \"Barbara Fleischman\")
\n25. (\"Medici\", \"has_possesion_of\", \"sarcophagus\")
\n26. (\"Medici\", \"has_possesion_of\", \"illegally-excavated artefacts\")
\n27. (\"Giacomo Medici\", \"sells_to\", \"Maurice Tempelsman\")
\n28. (\"Giacomo Medici\", \"sells_to\", \"Shelby White\")
\n29. (\"Giacomo Medici\", \"sells_to\", \"Leon Levy\")
\n30. (\"Giacomo Medici\", \"sells_to\", \"George Ortiz\")
\n31. (\"Giacomo Medici\", \"sells_to\", \"Jos\u00e9 Luis V\u00e1rez Fisa\")
\n32. (\"Medici\", \"donates_to\", \"J. Paul Getty\")
\n<\/code><\/p>\n

Ta da! A knowledge graph. To iterate over everything in our folder, we can use this one-liner:<\/p>\n

$find \/path\/to\/directory -type f -exec sh -c 'cat {} | llm -m 4 -t extract' \\; >> outputgraph.csv<\/code><\/p>\n

replacing \/path\/to\/directory of course.<\/p>\n

Now we\u00a0could<\/em> specify that the output follow turtle rdf conventions, in which case we would also get all of the properties for the entities and relationships. To do that, we change the prompt portion of our extract.yaml:<\/p>\n

prompt: 'Extract ONLY entities as indicated in the pattern, and ONLY predicates as indicated in the pattern. Return subject, predicate, object triples, as an ontology using RDF-Turtle for the input text, using the following guidelines: 1 \u2013 Denote subjects and objects using relative hash-based hyperlinks i.e., negating the use of example.com. 2- Output response to a code-block. 3 \u2013 Place ## Turtle Start ## and ## Turtle End ## around the code within the code-block.
\nerDiagram
\nAUCTIONHOUSE ||--o{ ARTIFACT : auctions<\/code> etc.<\/p>\n

We could specify that the output be written as cypher statements, meaning we could load the data directly into a Neo4j database. Another important thing to note is that all interactions are logged to a local sqlite database for further use; see https:\/\/llm.datasette.io\/en\/stable\/logging.html<\/a>. If you have datasette<\/a> installed, you can explore the results of your experiments by running datasette \"$(llm logs path)\"<\/code><\/p>\n

Handy, eh?<\/p>\n","protected":false},"excerpt":{"rendered":"

Simon Willison’s LLM package is a lovely little command line utility that allows you to work with many different large language models. In this post, we use LLM to extract a knowledge graph from a mermaid diagram sketch. 1. Sketch out the basics of your knowledge graph. On paper – yes, on paper! It’s quicker […]<\/p>\n","protected":false},"author":6,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_relevanssi_hide_post":"","_relevanssi_hide_content":"","_relevanssi_pin_for_all":"","_relevanssi_pin_keywords":"","_relevanssi_unpin_keywords":"","_relevanssi_related_keywords":"","_relevanssi_related_include_ids":"","_relevanssi_related_exclude_ids":"","_relevanssi_related_no_append":"","_relevanssi_related_not_related":"","_relevanssi_related_posts":"","_relevanssi_noindex_reason":"","_mi_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":"","_links_to":"","_links_to_target":""},"categories":[1],"tags":[63,26,68,27],"yoast_head":"\nUsing Simon Willison's LLM Package to Extract a Knowledge Graph - X-Lab<\/title>\n<meta name=\"description\" content=\"Simon Willison's LLM package is a lovely little command line utility that allows you to work with many different large language models. In this post, we\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/carleton.ca\/xlab\/2023\/using-simon-willisons-llm-package-to-extract-a-knowledge-graph\/\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"shawngraham\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/carleton.ca\/xlab\/2023\/using-simon-willisons-llm-package-to-extract-a-knowledge-graph\/\",\"url\":\"https:\/\/carleton.ca\/xlab\/2023\/using-simon-willisons-llm-package-to-extract-a-knowledge-graph\/\",\"name\":\"Using Simon Willison's LLM Package to Extract a Knowledge Graph - X-Lab\",\"isPartOf\":{\"@id\":\"https:\/\/carleton.ca\/xlab\/#website\"},\"datePublished\":\"2023-10-24T15:40:26+00:00\",\"dateModified\":\"2023-10-24T15:40:26+00:00\",\"author\":{\"@id\":\"https:\/\/carleton.ca\/xlab\/#\/schema\/person\/e8707158a71e77734ea13346b6e46feb\"},\"description\":\"Simon Willison's LLM package is a lovely little command line utility that allows you to work with many different large language models. In this post, we\",\"breadcrumb\":{\"@id\":\"https:\/\/carleton.ca\/xlab\/2023\/using-simon-willisons-llm-package-to-extract-a-knowledge-graph\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/carleton.ca\/xlab\/2023\/using-simon-willisons-llm-package-to-extract-a-knowledge-graph\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/carleton.ca\/xlab\/2023\/using-simon-willisons-llm-package-to-extract-a-knowledge-graph\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/carleton.ca\/xlab\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"News\",\"item\":\"https:\/\/carleton.ca\/xlab\/category\/news\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Using Simon Willison’s LLM Package to Extract a Knowledge Graph\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/carleton.ca\/xlab\/#website\",\"url\":\"https:\/\/carleton.ca\/xlab\/\",\"name\":\"X-Lab\",\"description\":\"Carleton University\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/carleton.ca\/xlab\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/carleton.ca\/xlab\/#\/schema\/person\/e8707158a71e77734ea13346b6e46feb\",\"name\":\"shawngraham\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/carleton.ca\/xlab\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/1b4be5c0f305aa12c7a3dd75ae5c731e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/1b4be5c0f305aa12c7a3dd75ae5c731e?s=96&d=mm&r=g\",\"caption\":\"shawngraham\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Using Simon Willison's LLM Package to Extract a Knowledge Graph - X-Lab","description":"Simon Willison's LLM package is a lovely little command line utility that allows you to work with many different large language models. In this post, we","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/carleton.ca\/xlab\/2023\/using-simon-willisons-llm-package-to-extract-a-knowledge-graph\/","twitter_misc":{"Written by":"shawngraham","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/carleton.ca\/xlab\/2023\/using-simon-willisons-llm-package-to-extract-a-knowledge-graph\/","url":"https:\/\/carleton.ca\/xlab\/2023\/using-simon-willisons-llm-package-to-extract-a-knowledge-graph\/","name":"Using Simon Willison's LLM Package to Extract a Knowledge Graph - X-Lab","isPartOf":{"@id":"https:\/\/carleton.ca\/xlab\/#website"},"datePublished":"2023-10-24T15:40:26+00:00","dateModified":"2023-10-24T15:40:26+00:00","author":{"@id":"https:\/\/carleton.ca\/xlab\/#\/schema\/person\/e8707158a71e77734ea13346b6e46feb"},"description":"Simon Willison's LLM package is a lovely little command line utility that allows you to work with many different large language models. In this post, we","breadcrumb":{"@id":"https:\/\/carleton.ca\/xlab\/2023\/using-simon-willisons-llm-package-to-extract-a-knowledge-graph\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/carleton.ca\/xlab\/2023\/using-simon-willisons-llm-package-to-extract-a-knowledge-graph\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/carleton.ca\/xlab\/2023\/using-simon-willisons-llm-package-to-extract-a-knowledge-graph\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/carleton.ca\/xlab\/"},{"@type":"ListItem","position":2,"name":"News","item":"https:\/\/carleton.ca\/xlab\/category\/news\/"},{"@type":"ListItem","position":3,"name":"Using Simon Willison’s LLM Package to Extract a Knowledge Graph"}]},{"@type":"WebSite","@id":"https:\/\/carleton.ca\/xlab\/#website","url":"https:\/\/carleton.ca\/xlab\/","name":"X-Lab","description":"Carleton University","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/carleton.ca\/xlab\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/carleton.ca\/xlab\/#\/schema\/person\/e8707158a71e77734ea13346b6e46feb","name":"shawngraham","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/carleton.ca\/xlab\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/1b4be5c0f305aa12c7a3dd75ae5c731e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1b4be5c0f305aa12c7a3dd75ae5c731e?s=96&d=mm&r=g","caption":"shawngraham"}}]}},"acf":{"Post Thumbnail Icon":"","Post Thumbnail":false},"_links":{"self":[{"href":"https:\/\/carleton.ca\/xlab\/wp-json\/wp\/v2\/posts\/158"}],"collection":[{"href":"https:\/\/carleton.ca\/xlab\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/carleton.ca\/xlab\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/carleton.ca\/xlab\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/carleton.ca\/xlab\/wp-json\/wp\/v2\/comments?post=158"}],"version-history":[{"count":3,"href":"https:\/\/carleton.ca\/xlab\/wp-json\/wp\/v2\/posts\/158\/revisions"}],"predecessor-version":[{"id":166,"href":"https:\/\/carleton.ca\/xlab\/wp-json\/wp\/v2\/posts\/158\/revisions\/166"}],"wp:attachment":[{"href":"https:\/\/carleton.ca\/xlab\/wp-json\/wp\/v2\/media?parent=158"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/carleton.ca\/xlab\/wp-json\/wp\/v2\/categories?post=158"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/carleton.ca\/xlab\/wp-json\/wp\/v2\/tags?post=158"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}