A simple question to this community, what are you self-hosting? It’s probably fun to hear from each-other what services we are running.
Please mention at least the service (e.g. e-mail) and the software (e.g. postfix). Extra bonus points for also mentioning the OS and/or hardware (e.g. Linux Distribution, raspberry pi, etc) you are running on.
Do you have a GPU in there with the Stable Diffusion? If not how’s it working? I’m debating moving to a machine I can’t guarantee my spare GPU will fit in.2
Yep, I’m using an RTX2070 for that right now. The LLMs are just executing on CPU.
Without a GPU, it’s pretty horrible.
That’s what I was afraid of. Wad gifted a Dell VRTX blade chassis and trying to figure out how to shove my spare 2080 Super in there and get it power.