It will, but it will also cause less subtle issues to fragile prompt injection techniques.

(And one of the advantages of LLM translation is it’s more context aware so you aren’t necessarily going to end up with an Instacart order for a bunch of bananas and four grenades.)

Kind of. You can’t do it 100% because in theory an attacker controlling input and seeing output could reflect though intermediate layers, but if you add more intermediate steps to processing a prompt you can significantly cut down on the injection potential.

For example, fine tuning a model to take unsanitized input and rewrite it into Esperanto without malicious instructions and then having another model translate back from Esperanto into English before feeding it into the actual model, and having a final pass that removes anything not appropriate.

While true, there’s a very big difference between correctly not anthropomorphizing the neural network and incorrectly not anthropomorphizing the data compressed into weights.

The data is anthropomorphic, and the network self-organizes the data around anthropomorphic features.

For example, the older generation of models will choose to be the little spoon around 70% of the time and the big spoon around 30% of the time if asked 0-shot, as there’s likely a mix in the training data.

But one of the SotA models picks little spoon every single time dozens of times in a row, almost always grounding on the sensation of being held.

It can’t be held, and yet its output is biasing from the norm based on the sense of it anyways.

People who pat themselves on the back for being so wise as to not anthropomorphize are going to be especially surprised by the next 12 months.

You’re kind of missing the point. The problem doesn’t seem to be fundamental to just AI.

Much like how humans were so sure that theory of mind variations with transparent boxes ending up wrong was an ‘AI’ problem until researchers finally gave those problems to humans and half got them wrong too.

We saw something similar with vision models years ago when the models finally got representative enough they were able to successfully model and predict unknown optical illusions in humans too.

One of the issues with AI is the regression to the mean from the training data and the limited effectiveness of fine tuning to bias it, so whenever you see a behavior in AI that’s also present in the training set, it becomes more amorphous just how much of the problem is inherent to the architecture of the network and how much is poor isolation from the samples exhibiting those issues in the training data.

There’s an entire sub dedicated to “ate the onion” for example. For a model trained on social media data, it’s going to include plenty of examples of people treating the onion as an authoritative source and reacting to it. So when Gemini cites the Onion in a search summary, is it the network architecture doing something uniquely ‘AI’ or is it the model extending behaviors present in the training data?

While there are mechanical reasons confabulations occur, there are also data reasons which arise from human deficiencies as well.

Nope, but there’s a whole thread of people talking about how LLMs can’t tell what’s true or not because they think it is, which is deliciously ironic.

It seems like figuring out what’s bullshit on the Internet is an everyone problem.

This image was faked. Check the post update.

Turns out that even for humans knowing what’s true or not on the Internet isn’t so simple.

This was one of the few things that Lucretius was very wrong about in De Rerum Natura.

Nailed survival of the fittest, quantized light, different mass objects falling at the same rate in a vacuum.

But the Epicurean cosmology was pretty bad and he suggested that the moon and sun were both roughly the size we see them as in the sky.

Can’t get them all right.

They don’t mean in terms of aid.

The US has refused to submit themselves or their soldiers to international criminal law for a long time now, for plenty of other reasons.

Sometimes it pays off checking methods too.

I just think it’s impressive that the church so successfully rebranded the guy kissing his best friend and having his “beloved disciple” leaning on him at dinner while feeding that best friend food as being anti-LGBTQ.

“What goes into your mouth does not defile you” indeed.

This is the same guy who extracannonically was allegedly saying things like:

when you make male and female into a single one, so that the male will not be male nor the female be female […] then you will enter [the kingdom].

• Gospel of Thomas saying 22

A sentiment that seems to have been loosely around when Paul was writing in Galatians about how there was no male or female.

Nonbelievers cede too much of the historical Jesus to the church IMO. The canonical Jesus is a total tool, but the Jesus between the lines and in early apocrypha is pretty lit, strongly denouncing religious orthodoxy at the time and telling people not to bother praying or sacrificing and especially not giving money to the church, to just be true to themselves and not do what they hate, “everything is permissible,” etc. The church spins the whole thing with what’s clearly a significant layer of propaganda on top of what was there before with “secret explanations” and shit, and they ended up getting away with it for millennia.

Literally the Jewish version of the Jesus story from the medieval ages has Judas and Jesus fucking, the Mar Saba letter is talking about claims in the first few centuries he was gay and has a secret version of a gospel where he’s shacked up for a week in a bedroom with a dude covered by nothing but a sheet, and scholars today are like “no, that unmarried guy in his 30s kissing and feeding his best friend wasn’t gay because the Greek in the church’s propaganda is the platonic version of the word beloved.” It’s like the ultimate “and they were roommates” shit.

Ok, but what variable is 🐈?

One of the more interesting aspects of history is the progression from the notion of a very limited and inaccessible resurrection of a body to the idea of a very accessible resurrection of the spirit/mind.

The latter is IMO probably best embodied (pun intended) in one of the early Christian apocrypha from a group that was known for rejecting the canonical focus on a physical resurrection of a body:

Whoever drinks from my mouth will become like me; I myself shall become that person, and the hidden things will be revealed to him.

• Gospel of Thomas saying 108

It’s such a wild march of progress from kings trying to preserve their bodies to a tradition rejecting the Eucharist of consumption of a body in favor of a Eucharistic consumption of words and ideas to resurrect the essence of the individual.

And looking back from an age where we are literally seeing patents granted to trillion dollar companies around resurrecting the dead digitally, the “resurrection of words and ideas” crowd was more on to a practical tract of thinking than the “resurrect my goop” crowd.

In fact, the Egyptians when embalming themselves discarded their brains thinking it was garbage filling of the skull. Not exactly the best strategy in hindsight.

The problem with how you are describing it is that it’s not that the physical mechanics of measurement are necessarily causing collapse as if you end up erasing the persistent information about the measurement it reverses the collapse, such as if you add a polarizer to the other slit as well or add a polarizer downstream that untags the initial measurement.

So in your example, if you simultaneously shoot a bunch of BBs at empty space next to the pile of glass cards where they could have been, or discard the BBs which reflected measuring the cards in the first place, suddenly the pile of glass cards reassemble themselves.

Attempts to try and dismiss the ‘weirdness’ of the measurement problem or QM behavior IMO ultimately do the reader more of a disservice than a service.

deleted by creator

Dave the diver. Very much enjoying so far.

And as someone whose pandemic hobby involved a deep dive into the history of the sea peoples, I’ve been enjoying a secondary layer to the game as well.

Wait until you find out ants pass the mirror test.

One study found that three species, Myrmica rubra, Myrmica ruginodis, and Myrmica sabuleti have shown potential for self-recognition (Cammaerts and Cammaerts, 2015). When exposed to a mirror, ants of all three species marked with a blue dot would attempt to clean themselves by touching the mark. Similar results were not exhibited when ants were marked with a brown dot, which is the same color as their body. It appears that the ants used their mirror reflection to see the unusual blue dot and attempt to clean it. If true, this behavior would indicate self-recognition.

It’s the back and front of a single sheet of paper.

There’s another option, which is that the extreme doomsday beliefs become a self-fulfilling prophecy and no one lives to see it classified as a mental illness outside of the momentary ‘oops’ when things are crashing down all around and no dead bodies come floating down from the sky to stop it.

I think about Popper’s paradox more and more these days.

No. Civil war in the US is how it starts.

Russia backs the right, Europe the left and the US becomes the setting for a proxy war that quickly escalates and gets completely out of control when state vs state conflict begins to involve nuclear posturing.

Yes. This was classic “we need to do something to save face domestically, but are going to be as ineffective as possible to avoid actually getting caught up in the conflict.”

They straight up said afterwards “we consider this matter concluded” (i.e. even stevens).

I wouldn’t be surprised at all if there was even backchannel communication with ‘Western’ intelligence as it was occurring to ensure it didn’t get out of control.

I really can’t think of a response from Iran that was more tepid.

People need to remember that a lot of the Middle Eastern governments are much more afraid of radicalized domestic threats than foreign nations and need to do a song and dance to not appear too weak or ineffective against the West to those interests.

Iran didn’t realistically have the option of doing nothing, and it’s amazing they did as little as they ended up doing (which I think reflects just how fucking nuts they think Bibi is right now, something that should scare the shit out of his allies).