• 0 Posts
  • 15 Comments
Joined 3 years ago
cake
Cake day: July 1st, 2023

help-circle


  • Very cool!

    The voice sattelites like this and the Home Assistant voice from a year back are great and I love seeing more options for self hosted fully local devices like this.

    But honestly, what I find is missing for a fully local smart home setup is a “brain” for running the assistant LLM in a simple way.

    There is plenty of cloud solutions for connecting AI, but true local hosting requires a rig with a proper GPU if you want timely responses. I wonder if it is possible to build a purpose built “brain box” for Home Assistant that is small, not too expensive, fully local.

    It just sucks needing a rig with a RTX 3090 or whatever to get the full chain to run fully local. Small LLMs are stupid as dirt and our Home Assistant Green is in no way equipped to handle any form of LLM. I managed to get my gaming rig to host an LLM that was good enough, but I don’t want my gaming rig to be always on, and if I start gaming on it, the GPU has to deallocate all LLM business.

    I love fully local stuff, but the LLM part seems very expensive. Even for such a simple thing as managing our lights and music.




  • I’ve been running Linux on a 1070 Ti for at least 5 years now and I have no driver issues.

    Most distros figure that out by themselves.

    If you pick a hands-on distro, expect to be hands on, but if you want stuff to just work, there are distros that make it just work.

    The drivers may not be super fresh, but that would be unreasonable to expect of a GPU released 9 years ago. But it still runs the games I need it to.







  • Yeah, same to you!

    I don’t like having to configure every detail of my computing experience. I like to be able to do so though. And that’s part of what makes me love NixOS. Most things can be enabled with a service.<whatever>.enable = true and it is installed and set up with very sane defaults. Essentially what other maintainers do, only that you had to decide you wanted that service to begin with.

    And for boring stuff like networking or whatever, I haven’t made many desicions my self. That just came with the default config from my base install. I brought them with me as I evolved it, and as long as I don’t need anything else, I won’t be changing it either.

    But yeah, I very much understand why someone would not want to use NixOS. It is great for those who like it and hell for those who just wants a set and forget system :)


  • Yeah, you have to define this stuff somewhere. But changing from one to another is simple.

    This is my audio setup right now:

      services.pulseaudio.enable = false;
      services.pipewire = {
        enable = true;
        alsa.enable = true;
        alsa.support32Bit = true;
        pulse.enable = true;
      };
    

    I will just keep rolling this until it constrains me somehow and then I will revisit it and improve it to fit my needs.

    If you like NixOS, this is not a big burden really. Otherwise you are probably better off with some other dist, as you mentioned.

    I don’t see it as a big tradeoff, but that’s because I like this way of doing things.


  • Yeah, it took me a good while to be comfortable. And I am still more or less a noob.

    I’d say I don’t fully understand the syntax properly, but I get around. The docs are great if you haven’t checked them.

    I have also been spitballing with AI to get input on how to attack new problems in there and I find that really helpful. If you are strongly anti-ai there are some good community chats on Discord, Matrix and elsewhere where people have been really kind and helpful as well.

    My recommendation is:

    • Start a new system using a single flake
    • Add what you need, when you need it
    • When it starts feeling unmaintainable, take a step back, stop adding new stuff and figure out how you can refactor your system so that you are back in control

    You have to think it is fun for it to be worth it really, but you seem sold on the concept, so I think you’ll get there!


  • I game on NixOS, ask me anything and I’ll do my best to answer :)

    To answer if NixOS is immutable, kind of yes if you want it to be immutable.

    It can really be whatever you want it to be. If you:

    • Use flakes and
    • Keep your config in Git

    Your system is pinned and reproducible.

    Applying the same config on any other system would result in the exact same setup. All around.

    When you want to update, you update the inputs to your flake, rebuild your system and switch into the new build.

    If everything is good, you commit the updated flake file and any other system can pull it to update to the exact same config state.

    It is magic and cool!

    Also, if you want, it can be the complete opposite.

    You can switch from the stable channels (new releases bi-annually) to the unstable channel (rolling release) and configure auto-updates.

    Now you have a bleeding edge system that updates daily.

    It is so cool.

    I get that there is a lot of terms and stuff that is unclear, but it’ll all clear up once you get into it :)

    But yeah, it is a OS that revolves around config files and kind of “coding” your own system.

    If that sounds like fun to you (I love it) give it a try! If that sounds daunting, maybe stick with Bazzite, CachyOS or something easy to use. NixOS is easy to work with once you get it, but so is rocket science I guess.

    I am rambling. Give it a try! Or don’t! 😄

    I am going to migrate our living room gaming PC, my Raspberry Pi and my server machine to NixOS once I get the chance to.

    This is my Linux endgame. I am not going back from here 😄

    NixOS is not really a distro like other distros. It is more like a framework of creating the perfect custom distro that fits YOU.

    If you’ve read this far, you’re a champ 🙏