Self hosting Sunday! What's up, selfhosters?
How's your stuff doing? Unplanned interruptions or achieving uptime records?
I'm currently sailing rather smooth. Most of my stuff is migrated to Komodo, there will stay some exceptions and I only have to migrate Lemmy itself I think. Of course that's when I found a potential replacement but I'll let it sit for a while before touching it again. Enjoying the occasional Merge Request notification from the Renovate Bot and knowing my stuff is mostly up to date.
I'm thinking about setting up some kind of Wiki for my other niche hobby (Netrunner LCG) lore as there's a fandom one that most people avoid touching and updating but since I likely won't have time to start writing some articles on my own as a kickoff I'm hesitant. Also not sure which wiki I'd choose as well.
like this
JASN_DE
in reply to tofu • • •Currently working on moving the more family-relevant services to OIDC-based login via Pocket ID passkeys so I can put my parents on them.
Also, still on the lookout for a good Nextcloud replacement. Even Opencloud displays the first signs of feature creep.
Dataprolet
in reply to JASN_DE • • •JASN_DE
in reply to Dataprolet • • •It grew from a nice Owncloud fork into a do-it-all groupware solution by adding on more and more things without really improving the basis. Each version the performance gets a little worse, syncing gets stuck more often, etc.
Opencloud looks or at least looked good as it started out as an Owncloud Infinite Scale fork, but of course they're adding on more and more groupware stuff without improving the core first. Maybe we're doomed to witness the same cycle with each solution, who knows.
franzbroetchen
in reply to JASN_DE • • •non_burglar
in reply to franzbroetchen • • •Lyra_Lycan
in reply to Dataprolet • • •GitHub - Blaok/nextcloud-inotifyscan: Automatically scan external changes for Nextcloud local storage.
GitHubslazer2au
in reply to tofu • • •like this
wagesj45 likes this.
Helix 🧬
in reply to tofu • • •like this
wagesj45 likes this.
tofu
in reply to Helix 🧬 • • •like this
wagesj45 likes this.
Dataprolet
in reply to tofu • • •tofu
in reply to Dataprolet • • •irmadlad
in reply to Dataprolet • • •I use NetData, with the v3 'switch' on the url. Example: netdata.mycoolserver.com/v3. The v3 lets you skip the login process and head right to monitoring observables. Some people may have concerns about NetData, however it covers just about every metric I think one would need, all in one package.
smiletolerantly
in reply to tofu • • •Planning to host a Nix caching server, and have CI build all package and NixOS outputs on every push to git, then in turn pushing the output artifacts to the cache. Would save me a good chunk of time when tinkering with VMs that haven't seen manual updates in a while.
Only thing is, I'm not sure how to approach building and caching NixOS configs that receive agenix secrets in their input. Obviously those should not be cached...
RecitalMatchbox
in reply to tofu • • •like this
wagesj45 likes this.
yo_scottie_oh
in reply to RecitalMatchbox • • •tychosmoose
in reply to RecitalMatchbox • • •Domi
in reply to tofu • • •I finally moved my mail server from Hetzner to my homelab.
Pretty smooth sailing so far. For now I'm using Scaleway for outgoing mails since I can't set a PTR record here but I might just try sending a few without PTR to see how other providers react.
Lyra_Lycan
in reply to Domi • • •abeorch
in reply to Domi • •Selfhosted reshared this.
gjoel
in reply to tofu • • •Just got some power measuring plugs. Home Assistant and immich-running raspberry pi + NAS (dual 20TB in raid 1) + switch clock in at around 30W. Surround receiver playing music ups that by 90W. After a minor water leak I added 5 leak sensors to the system that will blink lights and send texts if they detect anything.
The biggest problem is that I'm still running lights through hue and some of them have an annoying tendency to drop off the network...
Lyra_Lycan
in reply to gjoel • • •gjoel
in reply to Lyra_Lycan • • •MoonRaven
in reply to tofu • • •Lokisan
in reply to MoonRaven • • •Maerman
in reply to tofu • • •irmadlad
in reply to Maerman • • •I always hold my breath whenever I've done anything major to the server and I need to reboot.
Maerman
in reply to irmadlad • • •Witziger_Waschbaer
in reply to tofu • • •I recently switched my phone from Android to GrapheneOS and now rely even more on my selfhosted services. Immich is such a great project. Still gotta figure out my music collection though, since switching from YT Music to Jellyfin. Most of it is sorted by date of purchase, because that worked best with my DJ workflow. Now I gotta bring it over to a folder structure that works for jellyfin. It seems like the answer is musicbrainz Picard, but I gotta figure out how to configure it.
Also been thinking about some AI ideas I'd like to try, but I have zero intention getting involved with openai, meta, google or whoever the fuck. So self hosting it is. But on what hardware? Option 1 seems to be to get some professional server board, CPU, ram and start with one RTX3090 and go from there with the option to hook up more GPUs. But a setup like that sounds like it would cost some serious money in electricity.
Option 2 seems to be a Rzyen AI Max+ 395, configured with a fuckton of ram, available to the whole apu and as suchs usable for memory hungry models. This seems to be much much more power efficient. But its all integrated and I couldn't swap out components or upgrade in the future.
Leaning towara option 2 atm, but maybe I'll just wait a bit longer and see what else comes up in the coming months.
Lyra_Lycan
in reply to Witziger_Waschbaer • • •Nice.. I use ytdl-sub for downloading music, highly recommend it. You can write tag metadata but if you want embedded stuff I'd recommend trying beets. Running both as a user whose primary group matches Jellyfin is a must if you want stuff saved next to the video files.. The dev is also very active.
I just installed Ollama and use gemma3 for now. I wanted to use dolphin-mixtral but holy crap it wants more RAM than my entire setup
irmadlad
in reply to Lyra_Lycan • • •This is basically what I've found with self hosted AI. I just don't have the equipment for it. Would love to be able to host a selfcontained LLM, but alas, as you say, it eats up resources. FEED ME MAURICE!
brvslvrnst
in reply to Witziger_Waschbaer • • •BruisedMoose
in reply to brvslvrnst • • •I've just finished ripping about 1300 CDs. I used Jellyfin for a bit since I already had it set up for my video library, but I wasn't happy with the Android options and it was pretty basic.
Navidrome is a fucking TREAT. Paired with Symfonium, I'm finally enjoying my personal music collection regularly again.
As for tagging, OP, while I get why people like Picard, it doesn't always work with how I like to do things. I put everything into a music folder on my desktop, use Mp3Tag to retrieve metadata, edit what I need, and make sure the artwork is decent and sized where I want it. Then I use the tag > filename to organize and move them to my NAS.
irmadlad
in reply to BruisedMoose • • •I've found Navidrome to be quite capable of handling large music collections. I was worried in the beginning. It sips resources. When I fire it up and listen remotely, I watch the CPU and RAM. It barely moves the needle. Very happy with it.
southernbeaver
in reply to tofu • • •irmadlad
in reply to southernbeaver • • •southernbeaver
in reply to irmadlad • • •irmadlad
in reply to southernbeaver • • •Cauldron VTT
www.cauldron-vtt.netfrongt
in reply to southernbeaver • • •I recommend ComfyUI. It makes running everything trivial, and is very easy to learn, use, and extend.
I also recommend supporting artists directly and learning to draw.
southernbeaver
in reply to frongt • • •Lyra_Lycan
in reply to tofu • • •non_burglar
in reply to Lyra_Lycan • • •Lyra_Lycan
in reply to non_burglar • • •notquitenothing
in reply to tofu • • •I have been experimenting with a btrfs raid array and am getting some new hard drives in the mail today, hoping it goes smoothly and they work 😬 All part of a larger goal of migrating my synology NAS to a purpose built machine.
Also got my first contribution and donation on my OIDC SSO project, which is really exciting!
thelittleblackbird
in reply to notquitenothing • • •noorbeast
in reply to tofu • • •Just installed Owncast, so townsfolk can ride my G-scale Polar Express via an onboard livestream, as part of a revamped lighting and projection mapping festive season show.
While I was at it I also added Kokoro for TTS.
Thought I would spice up Jellyfin for the festive season, so am trying out the Jellyfin Enhanced and Home Sections plugins.
leverage
in reply to tofu • • •brvslvrnst
in reply to tofu • • •silmarine
in reply to tofu • • •irmadlad
in reply to silmarine • • •If you find that watchtower (original) screws up the updates frequently there is a watchtower fork that runs so much smoother. I don't have any issues with it at all. The original watchtower app hasn't had an update in 2 years, so it might be something to keep in mind.
Watchtower
watchtower.devcdn.netfrongt
in reply to irmadlad • • •irmadlad
in reply to frongt • • •I had that issue with Portainer recently. I had to drop back to the previous docker version, and held it until Portainer works through the snag. I didn't think about original watchtower being affected. I just got tired of having to fix broken updates, and went looking for something better. When original watchtower worked tho, it worked well.
silmarine
in reply to irmadlad • • •Watchtower
watchtower.nickfedor.comirmadlad
in reply to silmarine • • •curbstickle
in reply to tofu • • •A recent t480 purchase may replace my second workstation tower, which I think is about to become my most powerful server in the cluster....
So nothing new hosting-wise, but that tower I can shove the spare 12tb and 4tb drives I have and net myself another 30ish TB's of usable storage, more once I replace the 12TBs in one of my NAS boxes with 18tb or more.
Speaking of which - where the hell do I track prices these days? diskprices.com seems to be a mess of inaccurate pricing and shucks.top can no longer track even half of what they used to. What a mess.
iggy
in reply to curbstickle • • •curbstickle
in reply to iggy • • •Honestly with what Seagate has been doing with their externals, shucking is probably best avoided at this point.
That said, yeah, seems like and its not a perfect option either, seems like I'll have to use multiple sources and just keep an eye out with a daily check or something.
irmadlad
in reply to tofu • • •Everything here is smooth sailing. I have been trying to track down a bothersome Suricata entry.
ad nauseum. There are three individual ips. One from Singapore, one from China and one from Romania. They are being blocked, so that's good. Thing is, these are from realitvly 'clean' sources:
120.132.37.195 was not found in our database202.136.163.11 was found in our database! This IP was reported 5 times. Confidence of Abuse is 0%:On the server side, I have nothing calling out to these ip. That's what was really bugging me. Nothing server side, just these three bothersome ip hammering Suricata. Generally, I would dismiss as benign and part of normal UDP behavior. However, it's the constant hammering that makes me suspicious. Could be high volume port scanning. However, it could also be known attack campaigns like UDP amplification attempts.
Other than that, I might find something to get into today.
myrmidex
in reply to tofu • • •confusedpuppy
in reply to tofu • • •I started out rewriting my network backup scripts only to realize I was adding functionality to a previous script I wrote to automatically mount and dismount luks encrypted volumes. I still want to type in my luks passphrase because I don't want everything automated and prefer to include inconvenience as an additonal security measure in securing some of my data.
I also came to the realization recently that the reason I don't relate strongly to other self hosters is because I've unknowingly been trying to create a minimal self hosted system that is more beneficial to small, low powered devices.
I've been using Alpine Linux, I install only the bare, older but well established tools and have been creating scripts soley based off those tools instead of seeking out bigger, more complicated modern tools. For example creating workflows by only using
rsyncor using github.com/RayCC51/BashWrite to create a blog that only usesbashand GNUsedto create a static blog site.At least now that I'm aware of this, I can keep an eye out for such projects or communities and would hopefully be able to contribute something in that direction.
GitHub - RayCC51/BashWrite: Single pure bash script for make your blog. Easy and simple. Support darkmode, tags, RSS and extended markdown.
GitHubirmadlad
in reply to confusedpuppy • • •There's absolutely nothing wrong with minimal. The way technology is in this timeline, you really don't need a lot to get a lot out of it.
Jason2357
in reply to confusedpuppy • • •confusedpuppy
in reply to Jason2357 • • •I actually started with RPi's. The first one, a used Pi 4b, is dedicated only to HomeAssistant. I don't tinker with it anymore because it does what I want and I don't want unexpected downtime when I have to use the bathroom or use the lights in my room.
I bought a used Pi5 with the intention of upgrading later. In life I am quite minimal and find a joy in using what little tools and material I have to create something new. That seems to hold true to technology and scripting too. The RPi5 with an old USB3 HDD is actually way more power than I can currently use and can imagine using for a long time. The extra room to work is convenient though.
I'll have a look into some of the places you suggested, those seem like the places to draw good inspiration from, thank you.
FisherOfSaints
in reply to tofu • • •Trying to work up the courage to troubleshoot a very worrying disk error on the new NAS I’ve been building, which if solved will leave me the problem of working up the courage to try and migrate to the new server without losing my Plex library settings and progress.
Basically I’m frozen in fear.
K3CAN
in reply to tofu • • •tofu
in reply to K3CAN • • •IsoKiero
in reply to tofu • • •I installed Jellyfin on my server and threw kodi on a minipc I dug out of dumpster pile at work. Works pretty well, but my server needs more RAM and the minipc needs either a wireless keyboard or a USB-HID remote controller to finalize the setup. Also ran some wiring in the house and added two network sockets to a room where the whole kodi-tv-gamingpc-whatever-pile is going to live.
On the server RAM I found some on ebay, but if anyone is interested on 64G DDR4 ECC DIMMs I have a few. I thought they were supported on my server motherboard when I took them out from a old server at work but it supports only up to 32G ECC dimms.
jrke3ok2
in reply to IsoKiero • • •IsoKiero
in reply to jrke3ok2 • • •iggy
in reply to IsoKiero • • •IsoKiero
in reply to iggy • • •ohshit604
in reply to tofu • • •Tried to setup a personal matrix server last night, got it to federate, next step is Matrix’s Element Call, spent too many hours trying to block the
/_synapseendpoint with Traefik because it is recommended by Matrix, no luck unfortunately.All this in hopes I can add a Music Bot to my instance or something similar.
http: routers: matrix: entryPoints: - "http" - - Pastebin.com
PastebinEpicFailGuy
in reply to tofu • • •Xartle
in reply to tofu • • •h3ll3rsh4nks
in reply to tofu • • •Mostly everything is running smoothly. Been fighting with some zigbee integrations randomly dropping connection from Home assistant but it's nothing too important.
Biggest issue I've been facing is how to make sure all my media is properly encoded so jellyfin doesn't pin my cpu transcoding when I'm streaming to the onn boxes around my house. Debating if I need to dump the onn's and try to spin up raspberries for each TV instead
Int32
in reply to tofu • • •Wuttin
in reply to tofu • • •harrys_balzac
in reply to tofu • • •I dug out an old laptop and installed Yunohost on it. I was so excited until I discovered that my ISP uses CGNAT. I'm trying to figure out what I want to do next.
I am looking at using headscale or just paying the US$10/month for a static public IP from my ISP. If I go with headscale, then it appears that I wouldn't need Yunohost.
I'm a newb at this so there's a lot I don't know yet.
kossa
in reply to harrys_balzac • • •You can rent a cheap VServer as well and use its static IP to forward traffic. Easiest for it would be SSH reverse tunnel. Or you could VPN it with your homelab (connection established from within your homelab).
If you don't want to rely on an external service you could as well establish a VPN server within your homelab and use IPv6 to connect to it, although the disadvantage would be, that if you're trying to connect from IPv4 networks 'outside' that wouldn't work.
Just listing some options to research. Welcome to the hobby, have fun 🤗
harrys_balzac
in reply to kossa • • •I'd rather not rely on an external service if possible. I'm just starting to read up on doing the whole VPN thing.
I appreciate your response and will keep your suggestions in mind as I move forward.
jol
in reply to harrys_balzac • • •Chris
in reply to tofu • • •Pretty smooth sailing at the moment. I’ve got:
All running on a 4 node raspberry pi kubernetes cluster.
Pika
in reply to tofu • • •One of my drives crippled itself a few days back, not sure what caused it. Wasn't able to be resolved without a host restart which was unfortunate. SMART isn't failing and has been working fine, so I'm chalking it down to a weird Proxmox bug or something.
For sure expected I was going to need to do a rollback on an entire drive after that restart though. Still may have to if it reoccurs.
CCMan1701A
in reply to tofu • • •Evening is going ok, but noticed the screen saver on jellyfin isn't showing up lately.. need to investigate...
Also, watched the latest "Explaining Computers" episode today.
Karna
in reply to tofu • • •nert
in reply to Karna • • •jol
in reply to Karna • • •IncogCyberSpaceUser
in reply to tofu • • •rockstar1215
in reply to tofu • • •GitHub - journiv/journiv-app: Journiv - Self hosted private journaling app
GitHubtofu
in reply to rockstar1215 • • •rockstar1215
in reply to tofu • • •bluGill
in reply to tofu • • •zer0bitz
in reply to tofu • • •JTode
in reply to tofu • • •Bad week for me. Tandoor had become the home of quite a lot of recipes, and well, I'm never gonna just pull a docker container again without a backup, cause I did a pull and the bastard stopped working.
So I setup Django and got started doing my own recipe server cause I was never very enthused about Tandoor, too much netflix-like Presentation bullshit and did not allow for the very simple thing I wanted, which was, a compact list of my recipes by alphabet that I can swiftly click on the one I want.
I also need to get my Python chops back cause I think there will be jobs again, soon enough.
Meanwhile, anyone got any suggestions of a better recipe app? Needs to run as a Linux server, that's about it. I can go Tailscale if it has no security. If I get mine to something usable I'll make it available.
jol
in reply to tofu • • •Trying to smoothly orchestrate prowlarr, radarr, jellyfin, and transmission (via Proton vpn), using a big beautiful docker compose file. It's been working OK but not without roadbumbs and tough learnings. Keep messing up directory permissions one way or another.
Next step is setting up fail2ban on my public facing jellyfin to control things a little better. Everything is hosted at home, and I don't want to use cloud flare tunnels, are streaming video is technically not allowed in them.
If you have more good tips on securing a home server, let me know!
Also, this is all running on an ancient 2012 mac mini running Ubuntu. Slow as molasses and sometimes the fans make a noise. I should start looking into back-up solutions, at least for the configs.