It very much depends on your phone hardware, RAM affects how big models can be and CPU affects how fast you’ll get the replies. I’ve successfully ran 4B models on my 8GB RAM phone, but since it’s the usual server and client setup which needs full internet access due to the lack of granular permissions on Android (Even AIO setups needs open ports to connect to itself) I prefer a proper home server. Which, with a cheap GFX card, is indescribably faster and more capable.
Smee
It’s me, Smee
- 0 Posts
- 53 Comments
Some people would call that a challenge.
Smee@poeng.linkto
Privacy@lemmy.ml•EU is proposing a new mass surveillance law and is asking the public for feedback news
3·6 months agoWhy do you think they cooperate with hardware manufacturers instead of OS producers or infiltrating the FOSS community harder?
I can’t wait for the first fully open source computer.
Would old peanut butter kill ya? Perhaps that’s what they mean by “a lifetime supply”?
Crusty
“Honey, I bought a cow!”
Yeah, perfect.
Am I weird for wanting a machinegun that shoots hogs at peanut butter?
Smee@poeng.linkto
Funny@sh.itjust.works•When you marry someone who thinks aheadEnglish
111·6 months agoA single jar is more than enough for a lifetime.
Default apps can be removed but requires hooking up the phone to a computer through ADB. and zapping them one by one.
I just draw them.
While when I visited the UK in October/November way back, every geezer over the age of 50 ran around in shorts. Even when it was like 10C. I’ve no idea what drives them to make such decisions.
My first computer was two sticks we had to bang together but now modern technology has ruined what was a good thing.
Are you running ML models
Yes.
Whenever I hear someone mention JPEG XL allI think of is JPEG 2000.
Confessions by proxy according to the article and cleared by DNA. I don’t see the relevance?
It’s a bit of both from what I gather. I.e. The Golden State killer was caught through GEDmatch and 23AM users have to manually upload their DNA profile to GEDmatch. On the other hand GEDmatch gave unrestricted, undisclosed access to law enforcement to dig throught their database until users started complaining and it became opt-in to allow LE access.
Fun fact, GEDmatch is now owned by Qiagen which operates in around 25 countries. I wonder how many DNA profiles they have access to. I wouldn’t be surprised if they’ve mapped the entire human species to some degree.
https://en.wikipedia.org/wiki/Joseph_James_DeAngelo#Investigation
Yeah, I would advice against becoming a serial killer for starters.
People like that doesn’t know how much we have to hide.
I don’t even want people to know how I wipe my ass, let alone what genes I have.

I’ve successfully ran small scale LLM’s on my phone, slow but very doable. I run my main AI system on an older, midrange gaming PC. No problems at all.
Dicio is a pre-programmed assistant, which one can talk to if one has speech recognition software installed. It has a preset of tasks it can do, in my experience it’s quite incomparable to how LLM’s work.