summaryrefslogtreecommitdiff
path: root/Omni/Dev/Beryllium/Configuration.nix
diff options
context:
space:
mode:
authorBen Sima <ben@bsima.me>2025-02-04 21:17:29 -0500
committerBen Sima <ben@bsima.me>2025-02-04 21:17:29 -0500
commitd97ddbe2d844e5fae8bfa4fd4f1a047df81e36b5 (patch)
tree13611b5ee72ec08cfe3f4a58ec5d40e53be043f2 /Omni/Dev/Beryllium/Configuration.nix
parent9fd4b5da05b7ff5c248e3e3f96f13e7c98ec72f6 (diff)
Deploy open-webui
This is a very nice web ui frontend similar to ChatGPT that can use both OpenAI and Ollama as backends at the same time. Currently I'm just using it locally but eventually I think I'll expose it over the internet and use it as my go-to LLM interface.
Diffstat (limited to 'Omni/Dev/Beryllium/Configuration.nix')
-rw-r--r--Omni/Dev/Beryllium/Configuration.nix1
1 files changed, 1 insertions, 0 deletions
diff --git a/Omni/Dev/Beryllium/Configuration.nix b/Omni/Dev/Beryllium/Configuration.nix
index a371649..4a792ef 100644
--- a/Omni/Dev/Beryllium/Configuration.nix
+++ b/Omni/Dev/Beryllium/Configuration.nix
@@ -83,6 +83,7 @@ in {
hardware.nvidia.powerManagement.finegrained = false;
hardware.nvidia.open = true;
hardware.nvidia.nvidiaSettings = true;
+ hardware.nvidia-container-toolkit.enable = true;
hardware.keyboard.zsa.enable = true;