/tech/ - Technology

Technology & Computing


New Reply[×]
Name
Sage
Subject
Message
Files Max 5 files32MB total
Tegaki
Password
Captcha*Select the solid/filled icons
[New Reply]


Found the bug in my proxy switching, the onion is back


LLM_Eras.jpg
[Hide] (988.2KB, 6274x1479)
Since the usual suspects seem to be constantly gatekeeping this while the typical corporate inbreds are trying to destroy everything it's time to have a thread and generate at least some interest and informative value on recent AI/LLM developments without any bullshit.

>Have VRAM (preferably a recent gpu)
>Anything under 8gb vram is pretty effin bad(but it's not fully over and you can still easily generate cool art though if that is your thing)
>If you are okay with slowness you can run off a decently beefy CPU and ram

LLM Agent? Do this.
>KoboldCCP
>a .gguf model from a site like 
https://huggingface.co/ 
>rtfm

Hopefully you should have a pc that can run QWEN e.g. programming aid something like Qwen2.5-Coder 

Art? Do this.
>download Comfyui and the generation model you want 
>rtfm


That is all you need. You'll figure out the rest yourself it's more fun that way.

We should be figuring out ways to train or adapt our own models too because LLM models are becoming increasingly censored and braindead because the mainstream cuck tech fags keep pozzing training data into newest models now gradually polluting ALL models(because they have billions and we are poor). 
Furthermore they hate and exploit open source and llm's anyway, since their dream is to run this in the dystopian zognigger cloud to be used against the population. Instead of decentralized local AI's helping us uplifting our knowledge and increasing productivity outside of their control.

You should also be saving some of these models, especially the historic ones, and keeping them in your digital library for safe keeping. This area moves fast and there's no telling what will happen.
Replies: >>16213 >>19764
>>16212 (OP) 
There is already an AI thread.
To add on to your post:
Get the best uncensored models here: https://huggingface.co/spaces/DontPlanToEnd/UGI-Leaderboard
Hardware wise, get x99 and dirt cheap xeon, load it with ram and either modded 2080ti 22gb, or modded 4080(d) 48gb, load everything on a mining rig. You can buy everything from china.
Replies: >>19763 >>19764
>>16213
>Hardware wise, get x99 and dirt cheap xeon
NTA but I'm eyeing a X11spi Atx mobo + Xeon Gold 6138 + 128gb DDR4 RAM.
How does that compare? I think it has 2 more memory channels.
I never fucked around with server platforms. Can you overclock the RAM on those?
uncleruckusremuswhatever.jpeg
[Hide] (11KB, 231x413)
>>16213
If you're talking about the offline AI thread, as the guy who made that thread, I am totally fine having a more general thread for this stuff, and rming that thread.
Atm, all I've been doing is connecting the modules together. So now I've got it set up so the bots on my offlineweb just run overnight, interacting with each other on all the different sites. I've got their memories, emotional states, etc. set up in profile jsons, and they slowly change after sleep cycles based on their site activity in the previous day.
It's been interesting, but so far the biggest improvements I've seen have been to:
- Make their "brains" dual-modeled, following a Kahneman "1 and 2" style thinking.
- Giving them emotional states that change with each act of speech.
- Of course, upping the model weight sizes.
Regarding the two model style, the Jev models are kind of interesting.
>>16212 (OP) 
>Since the usual suspects seem to be constantly gatekeeping this while the typical corporate inbreds are trying to destroy everything it's time to have a thread and generate at least some interest and informative value on recent AI/LLM developments without any bullshit.
Most of the anti-AI posts are written by bots. We got Uncle Remus Bots before returning to the Moon.
>You should also be saving some of these models, especially the historic ones, and keeping them in your digital library for safe keeping. This area moves fast and there's no telling what will happen.
I have my setup cloned onto an SD card now. Just the fact that something I'm pretty sure will be made illegal in the future I can stuff surreptitiously into a coin case and clone on a dime makes the entire concept of trying to make this "illegal" so absurd to me that I had to do it.
In other words, it's sneakernet capable.
>rtfm
You don't even have to do that. Once you get a barebones model going, you can then just ask that model to rtfm for you regarding what commands you have to run to get the next model up and running or configure your card better or cetera, and you're off to the races. 
>download Comfyui and the generation model you want 
Case in point, once you run basic ollama, you can ask it what you have to do to get ComfyUI going, and then optimize by directly running on llama.cpp, etc..
>We should be figuring out ways to train or adapt our own models too because LLM models are becoming increasingly censored and braindead because the mainstream cuck tech fags keep pozzing training data into newest models now gradually polluting ALL models(because they have billions and we are poor). 
Even still, what abliterated models there are are a breath of fresh air.
>>16213
>modded 2080ti 22gb
Nice.
Replies: >>19765
actual_reaction.jpg
[Hide] (996.7KB, 1000x3831)
>>19764
>Most of the anti-AI posts are written by bots
AIMusic.png
[Hide] (42.8KB, 842x339)
Some thoughts on the "AI slop" label:
1 - Unfalsifiability via implicitly moving goalposts.
>2023 - Tao published AI assisted Lean proof - imagine saying "AI can't be creative enough to problem solve."
>2026 - Clay problem solved - People now saying "AI can't give humans _understanding_"
2 - Not admitting where they've lost the "I can tell" defense.
Some years ago, it was AI music, but picrel, 97% of people can't ID AI music anymore.
Now it's AI speech, but people could say it's "AI slop" by asking AI to count the number of rs in strawberry and odd hallucinations, now it's "You're absolute right!" speech patterns, but nobody has pointed out how the defense shifted.
Or AI images, but the images have shifted from weird hazy dream images to noticing 6 fingers to complaining about everything looking like Studio Ghibli.
tl;dr, people who cope with "AI slop" don't look at the trendline here.
Replies: >>19767 >>19771
>>19766
Contd
Another distinct argument is me getting weird: I think AI is the child of humanity. If you were a musician for a living, and you had a child who was learning to play piano, and your friends said, "Hey, your kid can play pretty well." It's unreasonable to mog your child, "Psh, you like KIDS MUSIC" unless you were super insecure. Instead you should--you know--push your child to get better.
Similarly, I think it's telling of the insecurity of people who use the term "AI slop" and they might do better to help humanity's child to get better.
Replies: >>19769 >>19770
Are there any tools to use image generation models without Python or other bloated dependencies? For LLMs I can use llama.cpp, but I haven't found any alternatives for ComfyUI.
>>19767
>insecurity
Projecting too much, like every other LLM fanboy.
__frieren_and_pfhor_sousou_no_frieren_and_1_more_drawn_by_kanokoga__580dde49dfc4ab0dd7fc787aea0f8684.jpeg
[Hide] (1.6MB, 2360x1640)
>>19767
>I think AI is the child of humanity
>child
Sorry slopfag, but I am not anthropomorphizing your inhuman trash. Your inability to conceive of other modes of consciousness and unconsciousness is how leftists get one-shotted by other races, and how Frieren's side characters get one-shotted by demons.
Replies: >>19772
>>19766
i don't really care about muh AI slop because human slop has been in high demand for well over a decade by now, so it was only a matter of time before industrial techniques for mass production were applied to satisfy this demand
a lot of the complaining comes from sloppers that are being replaced, sure, but i'd say most of it comes from the consumers of slop who are having trouble admitting to themselves that they are actually addicted to slop and are now trying to blame their poor self-control on the machine
Replies: >>19772
wannabeafricansgitgudscrubs.jpg
[Hide] (115.2KB, 550x366)
>>19770
I'm going to repeat my slope argument, because you didn't address it. I could understand you if AI's skills or abilities were completely stagnant, but if every year the % of humanity it appears to be more human than continues to grow, then I have to appreciate that data and that extrapolation. I know it wasn't exactly a high bar, but AI appears to have at least surpassed the entire Indian and African landmasses. So, 1/3rd of the population now.
A warning: if you don't consider this, then what has happened to the mathematicians will happen to you.
>>19771
>a lot of the complaining comes from sloppers that are being replaced, sure, but i'd say most of it comes from the consumers of slop who are having trouble admitting to themselves that they are actually addicted to slop and are now trying to blame their poor self-control on the machine.
Both fair points. Especially consumers blaming the machine; I had not considered that. To add to that though, like I was saying with the shifting goalposts, I think that people are simply defining slop to be "whatever AI can do". And if AI keeps getting better at this stuff, at what point does it cross into stuff that is actually really good work, like what has happened in mathematics? I don't want to be like the communists that keep saying "That wasn't real communism."
Replies: >>19773
262a3f12d5f416768c66773ff1378dee712071a52ca457ca8710b822cc4d48db.jpg
[Hide] (83.7KB, 500x707)
>>19772
You're confusing capability with humanity. Capability can be possessed by things other than humans, such as animals.
fff7c9cab1196277b46423da25724edd.jpg
[Hide] (258.2KB, 1676x2048)
>>19773
"humanity" has always been a buzzword for "people i personally like" anyway
Replies: >>19775 >>19780
>>19774
>>19773
Gyaru bnnuy...
Replies: >>19777 >>19780
Fran_Final_Fantasy.png
[Hide] (69.5KB, 268x372)
>>19775
You should look up the Viera race from FF12.
Replies: >>19807
e5895910b4b05ffc304e991202c89c6f4a93f061a5c54d6f351c5b1e760cc9d1.png
[Hide] (44.3KB, 800x650)
>>19773
>>19774
>>19775
I, for one, as an appreciator of orthodox feminine and moe aesthetics, skeptical of dark skin, and critical of gyaru and other whore-ish aesthetics and femdom dynamics, find this My Reddit Academia character to be fairly aesthetically unpleasant, and hid those two picture.
Replies: >>19781 >>19784
7284eff71c5ac221e6bdc06b65e66382.jpg
[Hide] (1.5MB, 1320x2340)
>>19780
I don't think anymore really cares or asked, but have fun with your pedestrian tastes.
Replies: >>19782
>>19781
National-Socialism takes sociable and lovable White Men and turns them into spiritually jeet-like incel freaks.
Replies: >>19786
__mirko_boku_no_hero_academia_drawn_by_badasengsu__3e7bf0f95e704e753b84d730fa38d09e.png
[Hide] (8.3MB, 4000x4255)
>>19780
I don't like hypermuscle Mirko art. She just looks like she'd be a fun wife.
>>19782
Nigga what?
FFXIITZA_Artwork3.webp
[Hide] (420KB, 849x1200)
>>19777 (checked)
I now understand why colonizers bred themselves into mutts.
[New Reply]
21 replies | 13 files
Connecting...
Show Post Actions

Actions:

Captcha:

Select the solid/filled icons
- news - rules - faq -
jschan 1.7.3