I did some wardriving a long time ago but never used those internet connections. And I shared my connection before and had a Freifunk router. With the neighbours not so much. I’m mostly nice to them and ask before borrowing their stuff.

I think that’s a size where it’s a bit more than a good autocomplete. Could be part of a chain for retrieval augmented generation. Maybe some specific tasks. And there are small machine learning models that can do translation or sentiment analysis, though I don’t think those are your regular LLM chatbots… And well, you can ask basic questions and write dialogue. Something like “What is an Alpaca?” will work. But they don’t have much knowledge under 8B parameters and they regularly struggle to apply their knowledge to a given task at smaller sizes. At least that’s my experience. They’ve become way better at smaller sizes during the last year or so. But they’re very limited.

I’m not sure what you intend to do. If you have some specific thing you’d like an LLM to do, you need to pick the correct one. If you don’t have any use-case… just run an arbitrary one and tinker around?

Thanks! I’ve updated the link. I always just use Batocera or something like that, which has Emulationstation and Kodi set up for me. So I don’t pay a lot of attention to the included projects and their development state…

I didn’t include this, since OP wasn’t mentioning retro-gaming. But Batocera, Recalbox, Lakka, RetroPie are quite nice. I picked one which includes both Kodi and Emulationstation and I can switch between the interfaces with the gamecontroller. I get all the TV and streaming stuff in Kodi, and Emulationstaation launches the games. And I believe it can do Flatpaks and other applications as well.

https://plasma-bigscreen.org/ from KDE? I’m not sure if they’ve replaced that since. Wikipedia says it’s unmaintained. Depending on your use-case, you might want to have a look at Emulationstation, Steam Big Picture and Kodi Plugins, as well.

Idk, can you easily replace the Location Services? The captive portal checker? GCM with a different push service, or the built-in Webview with a better version, and have the permission system and the firewall of the operating system prevent proprietary apps from having too much access and phoning home, unless they’re designed to allow it? …I mean sure, you can replace the default keyboard without much effort. But I thought all of the other things were impossible on a stock ROM and then you don’t even have things like storage scopes and so on?

Well, I already own a Pinephone and I can tell you it’s not a viable alternative. It’s awesome and great for tinkering. But try and use it for 2 days in real life and you’ll buy another Pixel and fit it with GrapheneOS, just to get on with your day. At least that’s what I did. It has minor hardware woes, major software issues, there is no modern standby and you just won’t get a notification if your friends change plans. And it’s 50 more annoyances like this each day. You constantly need to work around things like not being able to buy a train ticket. And the browser is as sluggish as on a first/second gen Android from 18 years ago. And a Librem isn’t substancially better, just 3x the price.

(And I’m not sure about Rossman’s take on Purism. They definitely made some bad decisions and severe mistakes. It is hard to do this. Projects run over budget. But it’s not necessarily all malice. I think Rosmann exaggerates it a bit for Youtube clicks. It’s more some stupid (and very questionable) business decisions. But there is more nuance to it.)

I think I’m fine. I’ll just search for some words in the title and that usually returns the correct post. And as long as it’s the Fediverse and not a closed forum with login or Discord, I can use Google, since it’s on the open internet. At least for Lemmy. Other than that it’s really hard. I don’t think any search engine can find me the article that I skimmed by Friday evening where I just vaguely remember on how it was about some Youtuber that I know, and I have no other information. I sometimes want to find stuff and it’s impossible. With any search engine/method. Sometimes my browser history helps me with that. Or homing in on a timeframe and a rough place and then scrolling through things. But a least for me it tends to be one of the two extremes. Either the rudimentary tools are fine. Or it’s really hard but a “better” search wouldn’t cut it either.

Uhm, what’s the alternative? I don’t want my phone to send my location 24/7 to Google or Samsung, whom I talk to and what webaites I visit, maybe every single keystroke if the keyboard does weird things for machine learning or backing up word lists in the cloud… I want an operating system that has all of this disabled per default. And as far as I know that’s some custom ROMs and there is no other alternative.

Maybe it’s easier to use another tool to create an install USB stick, like FAI or a preseed file or another method of doing an unattended install. At least Debian used to have those. Though I haven’t done it for a long time.

I think many people use it and it works. But sorry - no, I don’t have any first-hand experience. I’ve tested it for a bit and it looked fine. Has a lot of features and it should be as efficient as any other ggml/llama.cpp based inference solution at least for text. I myself use KoboldCPP for the few things I do with AI and my computer is lacking a GPU so I don’t really do a lot of images with software like this. And it’s likely going to be less for you than the 15 minutes it takes me to generate an image on my unsuited machine.

Maybe LocalAI? It doesn’t do python code execution, but pretty much all of the rest.

We have some of these things. You can type in dpkg --get-selections to get a list of all packages on a Debian distribution. You can use apt-clone to install or transfer all installed packages to a new system, with a single command. You don’t need to install every package seperately. And Fedora will have a similar concept. I think the package manager also keeps track of some of the config files. You can use dpkg-reconfigure to configure your locale and several other things. These are being used for fully automated rollouts. And I believe other distros have similar tools and package managers. And then we have proper configuration management like johntash said.

And remember, Linux is an organically grown ecosystem for quite some time now. We have things like the FHS and it’s always the same 3 locations where config files reside. But it’s not a tight ecosystem like iOS and there is no central authority mandating every developer on earth use the same config format and syntax to describe things.

NixOS on the other hand follows a declarative approach. You’d compare that to Debian configured by Ansible (for example). Not Debian alone. And I mean go ahead and install some software which isn’t packaged yet, and you’ll find out why NixOS isn’t more popular. It’s a nice and clever thing, though. Both the declarative aspect and being immutable. But it comes at a price. And then we have some issues with the implementation and I think the error messages are always very unclear. That’s the two main issues I struggle with. It always requires very advanced programming concepts to do very simple things, and I often need to have a look at the source code to find out what to do. And if the config doesn’t apply, it often provides a very unhelpful trace, sometimes it doesn’t even say which of my config file broke. Earlier this week, I spent almost 2 hours to do something that would have been an “npm install && npm run dev” on a different distro. And that’s why it isn’t very popular. It is very nice, though.

I used to run such things on my NAS/Server at home (And I still do, though I’m currently changing some things.) But in addition to the 4.50€ for ~20W of electricity, it was maybe 600€ for the machine, so another 5€ a month over 10 years. And then my internet contract is a bit more expensive because I need an IPv4 address which can do port forwarding… On the flipside, I can just attach a 10TB harddrive and have it available everywhere. And that’d be very expensive with a cloud service or hoster.

Yes. I also have my own small VPS doing this (Piefed), Peertube, eMail, Nextcloud… for myself and family if they want. And that’s $8 a month. I wonder why it doesn’t scale down drastically with more users. I mean sure they generate a lot of requests. But then you only need to cache an image or pull in the posts and replies once for 12.000 users, while my server does that just for me. (Albeit for Lemmy, which is way smaller than Mastodon).

Wow. That is a lot of server power. And these things ain’t cheap.

$5000 a month sounds a lot for forwarding text messages and images. According to the Fediverse Observer they have 12,000 active users (boils down to $5 per user a year), but still… Is it that much storage or computationally so expensive to federate posts?

I don’t think that’s affected. It sounds more like political propaganda which gets allowed. I bet this will still be censored and lead to demonetization just as it is today.

I’d just set up the reverse proxy on the VPS and make it forward everything via IPv6. But you could also use a tunnel/VPN, everything from Tailscale to Wireguard or even an SSH tunnel would work. And there are dedicated services like Cloudflare, nohost, neutrinet, pagekite…

I didn’t know that. Wikipedia says it’s only 35% of contributors who are employed by RedHat. But isn’t governance split equally between the community and RedHat? So it’s not entirely independent, but more a mix?!

I’m all for Linux distributions run and owned by the community. With those we don’t have to be afreaid of weird business decisions. Debian is a good example, and very democratic. But I believe several other distros are maintained by a community as well, including Arch, NixOS…