Even normal fridges are a memetic virus, fridges clearly live in a symbiotic relationship with humans. They make our lives better and in return we create more fridges. If they weren't useful to us, we'd stop making more fridges. Any medieval human who sees a fridge would instantly recognize why it's useful and valuable.
OP is right, anything popular is virus-like. Richard Dawkins invented the word meme for this all the way back in 1976.
At this point the primary axes for improvement seem to only/mostly be speed and personalized reward models. We seemingly have the general of notion "learning" and "intelligence" functionally complete
I definitely belong to the latter camp. After LLMs I view everything humans do very systematically and whenever said thing still feels fuzzy I just treat it as having a noise/smoothing term
Thankfully for me it happened a while ago, after chess was conquered. One of the most amusing (and depressing) things in the past few years of the current “AI era” is people making the same claims and having the same discussions about “intelligence” and “creativity” from ten, twenty or thirty years ago as their field is finally coming under attack by AI; they are finally going through what the competitive board game communities (checkers, Othello, chess, shogi, go etc.) have already come to terms with. There was no single moment but a gradual process over decades as the incursion became greater and greater, forcing a recalibration as previously held positions became indefensible. In my own case it spurred me to educate myself in many areas of mathematics, philosophy and neuroscience in particular where I was ignorant and has undoubtedly shaped my understanding of “intelligence”.
When people started claiming LLMs could not produce ideas outside of what they encountered in their training data, I was reminded of an old Chess Life article from the 60s reporting on the first chess computer to play in a tournament at a local chess club. One of the club members remarked that he did not believe that the computer could play moves that were not “put in” the computer in advance. There is an overwhelming sense of “here we go again”.
Regarding the LAION aesthetic predictor footnote, I don't see why a modern model and nonlinear classifier won't do a good a job. Is there a fundamental technical problem with the idea?
What would you have in mind for a modern model? Like Dino-V3 or something of that ilk?
For the LAION classifier specifically, it's trained on-top of CLIP. The bottleneck for accuracy isn't the linear/non-linear readout, it's CLIP's specific knowledge of the world.
CLIP was trained with a contrastive learning objective, where all it has to learn is that images of the same category are closer to each other than images of other categories (e.g. two items are both dogs so they should be closer semantically, while say a dog and a computer are different and should be farther semantically.
As a result CLIP is really good at object definitions, but struggles at pretty much everything else. Modern multimodal LLM's perceptual modules are much stronger than CLIP; that's why we chose fine-tuning a LLM rather then training a MLP on-top of CLIP (which would be a direct iteration on the LAION aesthetic classifier).
Aah, for this we're just trying to filter not generate. When it comes to conditioning, you'll still need a model that understands text since the primary control is text.
In the original Stable Diffusion, CLIP doubled as part of this LAION Aesthetic Filter as well as the text control for the generative model. But in the last couple of years, the field has drifted away from CLIP towards LLM hidden states (e.g. Qwen, Mistral, etc.). It turns out that text-to-image and text-to-video models do not need the visual prior from CLIP; instead the hidden states of multimodal LLMs act as better conditioning mechanisms.
But you are on-to something when it comes to leveraging pre-trained vision models as priors in generative image/video.
Nowadays, models like Dino-v3 (which have the strong spatial priors, you're talking about with LingBot) are being used in 3 distinct ways:
1) REPA: The DiT in the generative model minimizes cosine distance to another vision prior, like Dinov3. This paper from earlier this year, iREPA (https://arxiv.org/pdf/2512.10794) digs into WHAT specifically makes a good regression target for generative image.
2) VA-VAE: Most generative image/video models work in a latent space that's pre-trained separately. We wrote a lot about this in an earlier blog post (https://www.linum.ai/field-notes/vae-reconstruction-vs-gener...). But basically, VAEs that overfit to the reconstruction task create brittle latent spaces for generative models. One solution folks have figured out is to regress to a strong spatial prior like Dino, during VAE training. This is discussed at length in the VA-VAE paper(https://arxiv.org/abs/2501.01423). Recent image models like Flux 2, likely achieve their improvements through this type of VAE training.
3) RAE (Representation Autoencoder): This is the latest/greatest right now. Where generative image models are trained directly in Dino-v3 space; and then they just train a decoder to read back out into pixel space. (https://arxiv.org/pdf/2605.18324)
I strictly meant using the embeddings for training a reward model, not the generator. By good for generation I just meant the reward model might find more visual cues for aesthetic preference and avoid some of the spurious semantic correlation CLIP has
That might work! Off the dome, it’s not clear to me whether spatial/depth priors are better/worse than an LLM for this type of task.
Only reason I can think why the LLM might still work better here is that it’s trained to solve a bunch of different image/video related questions, so it’s perceptual modules may be more robust adaptive for this aesthetic grading task versus something like LingBot
Apologies for making the reply chain so long but I think a video like this somewhat proves how a lot of aesthetic preferences can be *ultra* sensitive to small visual details : https://youtu.be/twcMra_67-w?t=88
The video is timestamped to open at the comparison frame. I don't think an LLM can tell the quality difference without direct reference for comparison
reply