Not really a problem with putting other stuff on it, apart from adhering to security standards. If you want to separate your personal stuff from hosted stuff, go ahead, but just because its torrent, doesnt make it much different.
Put it in a VM if you dont have a second machine i guess.
Make a deal with the devil, and the cost might be your soul
Just saw it too :D
Why would you ever need such a feature? Closed.
Dont bother with raspberrypis for most things anymore. Too expensive for that old shitty hardware they put on the boards…
Machines like the Intel N100 is much simpler to deal with. No more shitty hardware incompatability and old CPU which doesnt even have proper modern HW offloading (looking at you Pi4… what a shitboard)
you want a frontend, not the “service” itself.
Under “service” i usually understand the main logic part of something. In this case the LLM-processing itself.
Thats probably where the confusion is coming from here.
Bandwidth is one part… Storage is theother and usually you have less storage than bandwidth anyways.
Please include the actual calculations for energy-prices as many, you may not know, live in different locations and pay different prices compared to you.
mhh… you might be correct.
I havent considered how easy it actually is to search for a comment and find the exact post.
Question is if searching indexers like public search-engines is enough to call the data easily re-identifiable.
Or if this usage of personal data is covered somehow else e.g. legitimate interest, weighed against the freedoms of the data subjects, as you have listed above already.
Of course they are linked, but removing the username from the comments means they are mostly anonymized as far as GDPR is concerned.
It is perfectly fine to unlink data and keep processing it, as long as its considered anonymized under GDPR.
Your post content here is also not considered personal data, it shows up on a lookup request because its currently linked. If i crawl the page and dont save the username, the resulting data can most likely be considered anonymized under GDPR as far as the current interpretation is concerned.
It only becomes a problem as soon as i become aware the content indeed did contain personal data or probably also if i could have expected it to with high probability.
And i’d have to make sure to remove obvious ways to re-link the content to your user (e.g. mentions of your username in comments).
Anything else requires precedence about ways to re-identify someone based on posts on a platform weighed against the users freedom and the difficulty of doing such re-identification.
Recital 26 discusses when something could be considered anonymous. (or rather when gdpr would apply at all, and what it means to have anonymous data)
Now i dont want to defend reddit here, but afaik most comments are not subject to GDPR as long as you dont know they contain personal data and they have been detached from other personal data fields (like username).
So by removing personal data fields, they most likely become “anonymized”.
Of course thats not the end of it, you have to consider the available technology to de-anonymize this data for it to be legally called anonymized.
But i dont think there has been any case where this was challenged before… and i bet most supervisory authorities would discard such complaints as being “too hard to follow through”. (i got that reply from the Netherlands authority for checking newsletter opt-in from a website)
And i certainly dont think reddit or any operator will be forced to delete comments because they could be deanonymized depending on the content the user wrote, when most comments probably cannot be deanonymized.
Having to check everything for potentially identifiable data in that regard would be ridiculous for website operators.
Maybe some light checks sure, but not as deep as it would be required to truly anonymize everything that a user could have written to identify them.
Alot of that information becomes fragments as soon as you unlink it from the user. e.g. 12 people in a post wrote “I am gay”, great. But if you cant link that back to other comments of the same users somewhere else, its not identifiable, just text.
As far as i understood tailscale funnel its just a TCP-tunnel.
So you handle TLS on your own system, which makes sure tailscale cannot really interfere.
If you already trust them this far, might aswell do the same with a VPS and gain much more flexibility and independence (you can easily switch VPS provider, you cannot really switch tailscale funnel provider, you vendor-locked yourself in that regard)
I’d connect the VPS and your home system via VPN (you can probably also use tailscale for this) and then you can use a tcp-tunnel (e.g. haproxy), or straight up forward the whole traffic via firewall-rules (a bit more tricky, but more flexible… though not that easy with tailscale… probably best to use TCP-tunnel with PROXY-Protocol).
This way you can use all ports, all protocols, incoming and outgoing traffic with the IP-Address of the VPS.
Tailscale might even already have something that can configure this for you… but i dont really know tailscale, so idk…
And as you terminate TLS on your home-system, traffic flowing through the VPS is always encrypted.
If you want to go overboard, you can block attackers on the server before it even hits your home-system (i think crowdsec can do it, the detector runs on your home-system and detects attacks and can issue bans which blocks the attacker on the VPS)
And yes, its a bit paranoid… but its your choice.
My internet connection here isnt good enough to do major stuff like what i am doing (handling media, backups and other data) so i rent some dedicated machines (okay, i guess a bit more secure than a VPS, but in the end its not 100% in your control either)
Many systems dont support subpaths as it can cause some really weird problems.
As you use tailscale funnels, you really want incoming traffic from the internet. I am not sure thats a good idea for e.g. homeassistant that is limited in access anyways.
Might aswell use tailscale and access the system over VPN.
And for anything serious i wouldnt use something like funnel anyways. Rent a VPS and use that as your reverse-proxy, you can then also do some caching or host some services there. Much simpler to deal with and full support for such things as you then have an actual public IPv4/IPv6 address to use.
Heck, dont even have to pay for it with the Oracle Always-Free system.
How much time do you have? Because even small models will take alot of time on that kind of hardware to spit out a long text…
And the small models arent that great. I think the current best and economic model would be a mistral, mixtral or dolphin.
If you got the power, nous-capybara is very good and “only” 34B parameters (loading alone needs like 40GB of memory).
When i was with a customer who was using one of ther VPS offers, performance was unexpectedly low and upon contacting support it was clear the small fish dont get great support answers, but rather pushed to the FAQ.
And i personally find their offerings and marketing scummy. Big promotional prices, but always some small print with a higher price after x Months.
Or just stuff thats not included by default.
I never had that with other (also very cheap) providers.
As long as it works great for you, i wouldnt see a reason to leave.
There arent that many providers offering such small ressources at all or at such a price. To be fair, not much one can do with those specs… 10GB storage is very limited already.
But for those specs… always free oracle tier would work too (though requires a credit card).
Ionos… not a good provider.
Great it works for you, but i wouldnt touch them with a long pole.
Created by an old internet provider (which is also not very good…), pulling every shady marketing trick weird “cloud” providers have…
Contabo is very cheap too, but i wouldnt trust them with critical stuff.
Netcup is next, quite good and still cheap.
Hetzner is very nice, but the cloud offers are expensive. the dedicated server offers though… holy sweetness, specially the auction servers.
Dont forget smaller providers either, they can have some good stuff, but cannot really compete with the big players. (i have one for clean ip space for mail)
Over the years hosting i learned that paying slightly more is often worth it depending on the needs.
And as my requirements went up, i moved up in the tiers. If you have a need for the dedicated servers, gets cheaper for what you get (though you need to manage the hardware side then too…)
Oh and dont forget the Oracle free offers. I dont really trust Oracle, but free compute is free… maybe dont store sensitive stuff though
What i have a problem is the developer accessebility.
I want to build my own sensors into boards and use those, but the devboards are so expensive, its not worth it.
A board with an esp8266 costs just 1-2€, with zigbee its 20-25€.
Might aswell go for the new esp32 versions now and use thread… and its still cheaper.
(though that wasnt an option a few years back, best option there was esp-mesh which kinda sucked)
I dont see how e.g. arch would be super hard to maintain.
There is a nice GUI program for installing programs and updates. (like many modern distros)
If you dont want to set everything up, go with Endeavour or Garuda.
I find rolling release to be easier to maintain and keep up to date than non-rolling.
Specially if you want up to date packages for desktop use.
Windows has a request assistance function? wtf… where is that found?
I only know Remote desktop tools and most of these work perfectly fine on linux as the client or even under Wine.
[Edit: woah, i did some rambling below here… not related to your specific case here, but some nice information maybe]
Linux as host is where it gets funny… bigger ones support X11, pretty much none support Wayland.
To be fair, its impossible to control mouse and keyboard under Wayland without root.
I think we now have some new desktop packages for gnome and kde which can do that, so now they need to be implemented.
But i dont see an effort being made for Wayland by the bigger providers in the near future… the market just isnt there and there is lots of uncertainty with the featureset.
Switched to Rustdesk a while back, works nicely as client, but only picture output with wayland as host.l as of now.
And i cannot copy&paste under wayland as client… even though it worked before…
Dont. They are notoriously bad at such things. Lack of Hardware acceleration mainly. These old Chips and problems with single-board-complications are just not worth it at such high prices.
An Intel N100 MiniPC will have much more compute with less complications.