You can host ollama and open-webui on container. If you want to wire search you can connect open-webui to playwright (also container) and searxng (also container) and llm will search the web for answers
- 0 Posts
- 28 Comments
vane@lemmy.worldto
Selfhosted@lemmy.world•What's the real danger of opening ports?English
1·11 months agothis is nginx / openresty config - upstream is just definition of server / bunch of servers if you do loadbalancing - you can specify load balancing strategies and stuff. Or when want to separate server layer from proxy layer.
stream { upstream something { server xxx:123; server yyy:321; } server { listen 666; proxy_pass something; } }https://docs.nginx.com/nginx/admin-guide/load-balancer/tcp-udp-load-balancer/
I use openresty with autossl, it renews certificates automatically. The only problem is maintaining subdomain allowance otherwise bots will ddos letsencrypt with random domain names, after some quota they will soft ban you for a week to create certificates for new domains / subdomains.
vane@lemmy.worldto
Selfhosted@lemmy.world•What's the real danger of opening ports?English
4·11 months agoyou can reverse proxy other ports than 443 and ex. upstream ssh, the advantage of having reverse proxy over everything is to have traffic in one place so you can manage it, that’s why for example kubernetes have ingress server, example nginx / openresty upstream ssh, you can restrict traffic to limited amount of IP etc.
stream { upstream ssh { server 127.0.0.1:22; } server { listen 2222; ssl_preread on; proxy_pass ssh; } }
Buy refurbished / used Mini PC with at least 16GB RAM and 1Gbit network card. Don’t bother with M.2, SSD is enough.
I have right now refurbished hp g4 ryzen 5 mini pc. There is 12 docker containers running there and couple applications in screen, I just add things. Don’t do ARM, as far as I remember running on ARM is compilation hell. Stick with x86. You want it to ease your life and not to make it harder.
https://en.wikipedia.org/wiki/Institute_for_Information_on_the_Crimes_of_Communism
https://en.wikipedia.org/wiki/Institute_for_the_Study_of_Totalitarian_Regimes
https://en.wikipedia.org/wiki/Institute_for_the_Investigation_of_Communist_Crimes_and_the_Memory_of_the_Romanian_Exile
https://en.wikipedia.org/wiki/Office_for_the_Documentation_and_the_Investigation_of_the_Crimes_of_Communism
https://en.wikipedia.org/wiki/Communist_crimes_(Polish_legal_concept)
vane@lemmy.worldto
Programmer Humor@lemmy.ml•Child labour with 10 years of experience, 'AI-native' accepting 250k lines of Cursor code
6·1 year agoThat’s how you do marketing.
You give billions of credit to rich people companies and create inflation. Companies go bankrupt, they create new companies and the process repeats. You stand no chance.
The future is P2P
vane@lemmy.worldto
Selfhosted@lemmy.world•Release 1.7.2 · LibreTranslate - A FOSS, self-hosted, offline capable Machine Translation APIEnglish
1·1 year agoI mean you can try how it works on this website, I believe api is paid for this one but it’s free if you host it yourself.
vane@lemmy.worldto
Selfhosted@lemmy.world•Release 1.7.2 · LibreTranslate - A FOSS, self-hosted, offline capable Machine Translation APIEnglish
2·1 year agoyou can try it here https://libretranslate.com/
searchxng, libretranslate
vane@lemmy.worldto
Selfhosted@lemmy.world•How to make an uninterrupted Live Stream, with fallback measures?English
4·1 year agoHave you tried liquidsoap ?
I remember to have it working with default software I got but it was 10 years ago.
Then they added this bloatware like media streaming addon or notification center. I have now entware with minidlna and set minidlna scanning disk once per day because media streaming was scanning all the time.
I haven’t figure out how to permanently kill their /usr/local/sbin/ncd, ncdb, qNoticeEngined, qulogdb, NotificationCenter, mariadb processes. If I figure out it it probably start working again.
vane@lemmy.worldto
Selfhosted@lemmy.world•Plex now want to SELL your personal dataEnglish
15·1 year agohashed email xD, if someone has email it’s just hash(email) == email. given how many emails leaked producing hashes of 90% of population emails is not a problem
vane@lemmy.worldto
politics @lemmy.world•Elon Musk is responsible for “killing the world’s poorest children,” says Bill Gates
518·1 year agoBill Gates seeks redemption by giving away blood money and blackmailing younger fellow satan worshipers. What a jerk. Fuck him.
vane@lemmy.worldto
Political Memes@lemmy.world•Remember kids! This is what capitalism wants for us!
131·1 year ago“He talked about helping his father in the fields. He was pulled out of school at about the eighth grade and forced to work in the fields. That was the name of the game. His father needed him to do that, so he did. However, I want you to know that he went back at a later time and finished high school.” –Lynda Baxter, daughter of Harold Walker
Dude was living 90 years was married 3 times and have one daughter. I wish everybody at least the same long happy life. https://morningsonmaplestreet.com/2016/10/13/harold-jewel-walker-geronimo-oklahoma-2/
vane@lemmy.worldto
Selfhosted@lemmy.world•How to use GPUs over multiple computers for local AI?English
1·1 year agoI run this one. https://ollama.com/library/deepseek-r1:32b-qwen-distill-q4_K_M with this frontend https://github.com/open-webui/open-webui on single rtx 3090 hardware 64gb ram. It works quite well for what I wanted it to do. I wanted to connect 2x 3090 cards with slurm to run 70b models but haven’t found time to do it.
vane@lemmy.worldto
Selfhosted@lemmy.world•How to use GPUs over multiple computers for local AI?English
1·1 year agoI believe you can run 30B models on single used rtx 3090 24GB at least I run 32B deepseek-r1 on it using ollama. Just make sure you have enought ram > 24GB.

For people who don’t know, you just buy certificates and your company is clean. https://en.wikipedia.org/wiki/Green_certificate