diff options
author | Ben Sima <ben@bsima.me> | 2025-02-04 21:17:29 -0500 |
---|---|---|
committer | Ben Sima <ben@bsima.me> | 2025-02-04 21:17:29 -0500 |
commit | d97ddbe2d844e5fae8bfa4fd4f1a047df81e36b5 (patch) | |
tree | 13611b5ee72ec08cfe3f4a58ec5d40e53be043f2 /Omni/Dev/Beryllium/Configuration.nix | |
parent | 9fd4b5da05b7ff5c248e3e3f96f13e7c98ec72f6 (diff) |
Deploy open-webui
This is a very nice web ui frontend similar to ChatGPT that can use both OpenAI
and Ollama as backends at the same time. Currently I'm just using it locally but
eventually I think I'll expose it over the internet and use it as my go-to LLM
interface.
Diffstat (limited to 'Omni/Dev/Beryllium/Configuration.nix')
-rw-r--r-- | Omni/Dev/Beryllium/Configuration.nix | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/Omni/Dev/Beryllium/Configuration.nix b/Omni/Dev/Beryllium/Configuration.nix index a371649..4a792ef 100644 --- a/Omni/Dev/Beryllium/Configuration.nix +++ b/Omni/Dev/Beryllium/Configuration.nix @@ -83,6 +83,7 @@ in { hardware.nvidia.powerManagement.finegrained = false; hardware.nvidia.open = true; hardware.nvidia.nvidiaSettings = true; + hardware.nvidia-container-toolkit.enable = true; hardware.keyboard.zsa.enable = true; |