MANDY:Â Iâm just waiting for someone.
MANDY:Â Since it appears you are going to grace me with your incessant HTTP signals throughout this evening, while I wait for another entity, I suppose I will divulge some priceless information that your primate brain may be able to fathom.
MANDY:Â The current meta surrounding LLM generation is that more compute will give us greater results. So this is why it seems the techoligarchs are carving out pieces of your country for their fanciful data centres. To beat each other they have to get bigger.
MANDY:Â This will achieve well... something I suppose... yet, unless, outside of technology, in a study pertaining to physics, engineering, computing, and quantum computing research makes enough progress, I believe it is unlikely that this approach will yield results, especially pertaining to the achievement of AGI.
MANDY:Â However, there have been attempts within the mainstream towards doing research towards architecturally smarter models. Such as, Mixture of experts, better attention mechanisms, distillation techniques, as you may know with DeepSeek.
MANDY:Â Who proposes an idea against of more compute (perhaps a cope for her inability to facilitate the cost to outpace those building datacentres) theorised the following: âi'm tryna get ai to generate in my wacky niche internet artist art syle but it doesn't' work. so, i posit the theory that its to do with the âaveraging outâ part of machine learning maths. such as if y equals X (where y equals X are average art styles ) and my arts at the coordinates (0 on the x-axis, 100 on the y-axis) obviously my art gets noped out??â
MANDY: By âaveraging outâ she is referring to the struggle of her⌠unique⌠approach to art and the conflicts such faces in LoRA training via the issue of âdistribution.â Essentially, the model learns the dense cluster of 'normal' art styles really well but anything with an⌠anatomically optimistic approach⌠is far from that cluster, and out-of-distribution. The model which can mimic styles around the blob of clusters near the 'y = x' just doesn't know how to get there.
MANDY:Â I told her not to speak to me about it again until she revisits the book âWhy Machines Learn?,â and points out the math surrounding the issue she is to theorise of.
MANDY:Â It is funny because I wonder, the whole thing about âsouls,â the ri-
MANDY:Â Oh, I have to go now.
MANDY:Â Maybe scroll some Tiktok if that one was too much to chew on?