For it to contribute to the public, I would also want some sort of way to help the admin notify the oublic about it. I was even thinking that this would come with its own cli tool to check that the instance was visible on the open internet, and the present in public instance lists like searx.space. In this case, building and configuration is alrwady handled by NixOS, which is nice. I havent looked into others.
That looks like the same idea for a different set of tools. That’s a great reference, thank you!
I’m pretty ignorant on crypto, I just knew that it was important to have many mining to increase transaction times, decrease transactions costs, decentralize proof of work, etc. And practically you’re right, might be a good way to absolutely ruin the performance of the server.
Pff, if pandas gets me numpy that works that may not be a bad hack. I’ll try this! Sorry I dont know how to fix qt!
I’ve had the same problem running numpy. Shockingly with a library so popular I havent found a way to make an environment with it work. I also had the most success with poetry, so I think you’re on the right track.
From my short time with proxmox, I had to dive into the command line to do configuration at the host level that couldnt be done with the UI. I think nixos will help replacd those ad hoc configurations with nix options. In the many articles I read about gpu passthru, and also doing harddrive passthru, I had to work in the host debian environment.
I dumped proxmox because I couldnt get gpu passthrough to work, and havent looked back. Nixos modules and docker have served me better than VMs for my usecase.
This guy develops on windows
not sure if this fits your usecase, but nixos-mailserver
I used nixos-mailserver with success, and very little configuration. Most of it was dns, and thr guide walked me through it. You would have to a nixos box somewhere though. I spun one up on my vps for it.
If you enable iptables you may have to disable firewall.
I am also using nixvim. Didn’t know about this fork. I think I like it? It beats manually writing setup configs. But Im not a vim superuser by any means, so I’m sure nixneovim would be equally useful to me.
Use git? Use CI/CD? What do you mean?
That’s right, “text-generation-webui”. At least its unambiguous lol. Thanks for sharing.
What GPU are you using to run it? And what UI are you using to interface with it? (I know of gpt4all and the generic sounding ui-text-generation program or something)
Yes I’ve got that set but still running into issues at runtime.
It was not configured correctly. Its a nixos bug. Thanks for pointing out the daemon config its what lead me down to solving the docker problem.
Yes thats the nvidia-container-toolkit I described above. It should be installed.
Do you prefer the track ball for your thumb or for your middle finger?
Sorry about your troubles. Keep at it, I promise its greener on the other side.
One tip: nix-env installs things ad hoc. Its against fhe whole philosphy of nix, where your system state is defined in files. So don’t ever use that. If you need any generic package, you can add it to environment.systemPackages. If you accidentally installed something that way, its okay. Just know you might get an error if you try installing it both from nixos-rebuild and nix-env. If that happens, just uninstall from nix-env.
It seemed nice at first, but one major issue: GPU passthrough was a nightmare. It cant be done in the UI and I didnt understand fully how it worked. There are many different tutorials not by promox that are outdated or may not work. It was frustrating enough I jumped to NixOS. Other hiccups included having to go to the terminal to passthrough drives for openmediavault, but that one was kind of straightforward atleast, and it worked first time.
In hindsight, I didnt actually need to virtualize everything at that level, so I never really had a good use case for it anyway. I use containers over entire VMs.