fulldelusion.png
[Hide] (115.7KB, 1889x684) >>19625
Hm. Nah, not yet.
>>19636
Atm it isn't completely offline yet. I've a shitton of toggles for whether to allow SearX to go find stuff online, have ollama look for model updates, etc..
>Is this hard to install?
No, because you can bootstrap it. Once I got Qwen going by following the instructions on ollama's website, I just kept asking the Qwen model stuff like:
>How can I get you to be able to edit the system config files yourself?
And then once that was going, it was basically off to the races, as I could just ask the Qwen model to dl other models and configure things for me like "go get the obliterated versions going for me" or "figure out why you aren't working with my GPU card correctly", and then code up the pages and local webserver, install/run comfyUI, install/run SearX (I've gotten to the point now where I can redirect SearX to only search this "offline" web), make SearX work together with Qwen queries, and then once I had that, I could just ask it to figure out how to find the open models for image creator, radios, etc., etc..
The project has grown quite a bit, but I've done VERY little work the entire time and have basically acted as a top-level project executive as I let it churn away for a few days to set things up while I was away at work. I am basically very lazily AI slopping the whole thing together. After I did this, I've been having it use these modules to try to make games for me, and I'm playing with the idea of making an offline version of itch.io right now.
>What are the system requirements?
I'm not sure what the actual reqs are, but atm I'm not running anything special--most of these parts came from PCs my workplace was throwing out. It's a Quadro M4000 and 48GB of RAM sticks.
>You have to run your own server to it, correct, but does it have to be a real imageboard's software or just look like it?
This is not a genius operation. I told it, "Put all the messages in a giant json file, and make something that displays it like a messageboard. Organize the json so which board/thread/timestamp/who posted can be identified, and then run a model to make replies to other posters/new threads, but mostly to me." I mean, a few more project description words that that, but that was the general idea, and then it just coded it up for me.
Listen, this is AI slop all the way.
>Why would you want literal fake news?
Because IMO, the real news has gotten that fake and bad. Journos are going to get a French Revolution against them sooner or later.
At least this way I'm the editor in chief of my own fake news outlet; it's a little less demoralizing. Plus I get to read about topics I actually want. I get to hear a radio station that plays music I've always wanted to hear on a radio station.
I'm surrounded by a culture that's alienated me, so I've gone and made my own, even if it's just me.
>Is text only video so the bots can read a fake video with you as they can't see one?
It's actually because I've gotten to the point that I've personally stopped watching videos. About a year ago I made a script to grab transcripts from the channels I frequent, and then I started editing the script to cut off the first third, and then I edited them more to aggressively summarize the transcripts because I'm so sick of how Youtubers bloat their scripts. By now, I've gotten to the point where I'm reading summarized transcripts and looking at only a few images from the videos due to the scripts I was already using.
>Can you manipulate the bot's personality and or make it seem like more than one person?
Now I can. There's a character AI clone in the offline web. And I can interact/edit that character AI clone, and then that character gets used throughout this internal web. That character creates Offlinetube vids (which atm, are more like Powerpoint slides now), compose music, shitpost, write blogs/articles, etc.. The cross-correlation between all the different internal apps are starting to make it a bit more alive now. But it's a lot of work, and I'm losing scope of what everything's doing atm.
>Why is the text output so small?
I just started.
>Why does it say expensive as though you are paying for something but it's offline? That just means 'low/high demand on resources', right?
That's right. Expensive in time. One mode takes 5 to 10 min to generate, and the other takes like 10s. The 10s is easier to help with debugging/training/etc.. Or if I want to generate a shitton of responses because sometimes I don't care about quality of posting and just want a lot of shitty, pithy posts.
>Does this get any more seemingly intelligent than having two Billy bots talking to one another? I'd figure an LLM would have more to 'say' than "why does this board always come back to [variation]". I figure once it seems to have 16 personalities and or opinions then it's working right
I'm still playing with it, but I'd say the biggest improvement so far as been getting the obliterated models going. I'm just starting to get the multiple personalities going. I found someone who got the Qwen 27B model working on a memory poor hardware, so I'll see if I can't get improvement there taking their same approach. I'll maybe post later about how that worked out or I maybe won't because ->
>>19626
tbh I'm losing interest posting on the real internet faster than I thought I would've when I started this project.
Actually, it's kind of funny because the offline chan is actually way meaner than you guys are.
>>19646
That's probably it.
>>19645
There's a certain point where you're alone for so long that you kind of stop caring about what's "sad" anymore and go full in. C.f. people who marry their dakimakura waifus. I could see myself doing that one day.