If you were running a LLM locally on android through llama.cpp for use as a private personal assistant. What model would you use?

Thanks for any recommendations in advance.

  • hauiA
    link
    fedilink
    arrow-up
    22
    arrow-down
    12
    ·
    3 days ago

    Running an llm on a phone will absolutely destroy your battery life. It also is imperative that you understand that the comfort of ai is bought with killing of innocents (through expediency of climate catastrophe, exploitation of the planet and the poorest on it).

    I think using ai to experiment on a home server which already exists wouldnt be problematic IN A VACUUM but you would still normalize using the tech which is morally corrupt.

    • Fisch@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      19
      arrow-down
      8
      ·
      3 days ago

      Not trying to instigate a fight but if you make this argument, I hope you’re also vegan

      • JandroDelSol@lemmy.world
        link
        fedilink
        arrow-up
        4
        arrow-down
        1
        ·
        2 days ago

        I mean, ideally yes, everyone would go vegan, but that’s a far bigger lifestyle change than just continuing to not use AI like we’ve done for decades

      • hauiA
        link
        fedilink
        arrow-up
        8
        arrow-down
        10
        ·
        3 days ago

        Oh yeah. So i cant ask for one thing and not do another. Classic bad faith argument. Good try.

        • Fisch@discuss.tchncs.de
          link
          fedilink
          English
          arrow-up
          9
          arrow-down
          2
          ·
          2 days ago

          I’m not even trying to argue against you, I’m arguing for veganism. The same arguments that you used for why the use of AI is bad can be used for why not being vegan is bad. The production of animal products even has a way bigger impact.

          • hauiA
            link
            fedilink
            arrow-up
            3
            arrow-down
            2
            ·
            2 days ago

            In that case i very much suggest a different approach.

            “If that is your take, you will love veganism.”

            Btw, i dont eat animal products. Pretty recently too.

            • hauiA
              link
              fedilink
              arrow-up
              7
              arrow-down
              1
              ·
              2 days ago

              It is not. Eating meat is actually a torture and murder industry and people who eat meat are actually eating pieces of corpses.

              Even when I still ate meat, I could understand that morally there is no difference to eating humans.

              • N0x0n@lemmy.ml
                link
                fedilink
                arrow-up
                2
                arrow-down
                1
                ·
                2 days ago

                Not only that… The meat industry is poisoning the animals with antibiotics, GMO cereals… they live in 1m2 of space/cow, and living in hell 24/24, feel anger, hate, sadness and treated like shit and pure pain while beaten by humans… It’s horrible !!

                And all these things are digested by our body… Ugh ! It’s similar to a concentration camp but for animals…

                • HiddenLayer555@lemmy.ml
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  arrow-down
                  1
                  ·
                  edit-2
                  2 days ago

                  Eating meat is natural and occurs whether you and I exist or not.

                  So is killing the top ape in your troop so you get his harem. So is eating the babies of the former troop leader so you free up the female apes to care for your offspring instead of his. Nature is a hellhole and more importantly, isn’t a deity or even a conscious being. It has no morals, nor a will, nor any opinions on how living things should act.

                  If you’re going to enjoy the comfort of modern technology, especially modern food production technology, the “nature” argument is not applicable because none of the food you eat is remotely natural. You’re welcome to sharpen a stick with your teeth and use your real human hunting skills to get your meat, i.e. chasing down wild animals until they die from exhaustion. Better hope that wild bull with razor sharp horns that weighs three times more than you doesn’t figure out that they can just turn around and attack you head on, because hunting large animals is lethal to the hunter almost as often as it’s lethal for prey. You also better not use any antibiotics if your hunt leaves you wounded, because animals getting slowly and horrifically killed by bacterial infection is natural and occurs whether you and I exist or not. Microbes are your only real predator so you better respect that.

                  • J52@lemmy.nz
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    ·
                    2 days ago

                    Just because things are natural doesn’t mean you can’t apply reason. Anything that’ll end up killing ourselves, in the greater picture, is petty stupid, especially if it only provides short term comfort we easily can do without.

                • hauiA
                  link
                  fedilink
                  arrow-up
                  1
                  arrow-down
                  1
                  ·
                  edit-2
                  2 days ago

                  Greenpeace isnt even mainly focused on meat production afaik so no idea where you got that from but its not from then that we get information. You can see this on state tv. I dont know what your point is but i dont think you can prove that.

                  I know that logical thinking is optional but please go touch grass. Reported.

            • HiddenLayer555@lemmy.ml
              link
              fedilink
              English
              arrow-up
              2
              ·
              edit-2
              2 days ago

              Literally any lifestyle can become a cult. The presence of vegan cults is because veganism is more popular than ever so evil people exploit that to form cults. There are fitness cults too, does that mean everyone who works out is a cult member?

    • nagaram@startrek.website
      link
      fedilink
      arrow-up
      3
      arrow-down
      2
      ·
      2 days ago

      I am a fan of LLMs and what they can do, and as such have a server specifically for running AI models. However, I’ve been reading “Atlas of AI” by Kate Crawford and you’re right. So much of the data that they’re trained on is inherently harmful or was taken without consent. Even in the more ethical data sets it’s probably not great considering the sheer quantity of data needed to make even a simple LLM.

      I still like using it for simple code generation (this is just a hobby to me so Vibe coding isn’t a problem in my scenario) and corporate tone policing. And I tell people non stop that it’s worthless outside of these use cases and maybe as a search engine, but I recommend Wikipedia as a better start almost Everytime.