diff options
| author | Ben Sima <ben@bsima.me> | 2024-05-14 09:35:45 -0400 |
|---|---|---|
| committer | Ben Sima <ben@bsima.me> | 2024-05-20 22:15:49 -0400 |
| commit | 2d33aa547ff6a516c90ca2b47b13e2add200583a (patch) | |
| tree | 8d4941699982c59c6430f4b9a629b8ea91245bb1 /Biz/Bild/Sources.json | |
| parent | cceefa62d147594d43478e398bbaa9c630670935 (diff) | |
Add simonw/llm as cli/library client for running LLMs
This is basically exactly the client library that I would write myself. Some
parts of it are still beta quality, but it's the sort of thing that I would
contribute to anyway.
Unfortunately I couldn't get the llm-llama-cpp plugin to work because it depends
on llama-cpp-python which is not packaged for nix and is hard to package because
the upstream project vendors a patched version of llama.cpp. So I'm stuck with
ollama for now, but that's fine because it actually works.
Diffstat (limited to 'Biz/Bild/Sources.json')
| -rw-r--r-- | Biz/Bild/Sources.json | 13 |
1 files changed, 13 insertions, 0 deletions
diff --git a/Biz/Bild/Sources.json b/Biz/Bild/Sources.json index 40bcdfb..3b1e4fd 100644 --- a/Biz/Bild/Sources.json +++ b/Biz/Bild/Sources.json @@ -77,6 +77,19 @@ "url": "https://github.com/MegaIng/interegular/archive/v0.2.1.tar.gz", "url_template": "https://github.com/<owner>/<repo>/archive/<rev>.tar.gz" }, + "llm": { + "branch": "main", + "description": "Access large language models from the command-line", + "homepage": "https://llm.datasette.io", + "owner": "simonw", + "repo": "llm", + "rev": "0.13.1", + "sha256": "0305xpmigk219i2n1slgpz3jwvpx5pdp5s8dkjz85w75xivakbin", + "type": "tarball", + "url": "https://github.com/simonw/llm/archive/0.13.1.tar.gz", + "url_template": "https://github.com/<owner>/<repo>/archive/<rev>.tar.gz", + "version": "0.13.1" + }, "niv": { "branch": "master", "description": "Easy dependency management for Nix projects", |