• 0 Posts
  • 110 Comments
Joined 1 year ago
cake
Cake day: June 16th, 2023

help-circle

  • kromem@lemmy.worldtoScience Memes@mander.xyzGet good.
    link
    fedilink
    English
    arrow-up
    4
    ·
    10 days ago

    Because there’s a ton of research that we adapted to do it for good reasons:

    Infants between 6 and 8 months of age displayed a robust and distinct preference for speech with resonances specifying a vocal tract that is similar in size and length to their own. This finding, together with data indicating that this preference is not present in younger infants and appears to increase with age, suggests that nascent knowledge of the motor schema of the vocal tract may play a role in shaping this perceptual bias, lending support to current models of speech development.

    Stanford psychologist Michael Frank and collaborators conducted the largest ever experimental study of baby talk and found that infants respond better to baby talk versus normal adult chatter.

    TL;DR: Top parents are actually harming their kids’ developmental process by being snobs about it.




  • kromem@lemmy.worldtoScience Memes@mander.xyzJet Fuel
    link
    fedilink
    English
    arrow-up
    70
    ·
    edit-2
    2 months ago

    I fondly remember reading a comment in /r/conspiracy on a post claiming a geologic seismic weapon brought down the towers.

    It just tore into the claims, citing all the reasons this was preposterous bordering on batshit crazy.

    And then it said “and your theory doesn’t address the thermite residue” going on to reiterate their wild theory.

    Was very much a “don’t name your gods” moment that summed up the sub - a lot of people in agreement that the truth was out there, but bitterly divided as to what it might actually be.

    As long as they only focused on generic memes of “do your own research” and “you aren’t being told the truth” they were all on the same page. But as soon as they started naming their own truths, it was every theorist for themselves.






  • kromem@lemmy.worldtoProgrammer Humor@lemmy.mlLittle bobby 👦
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    5 months ago

    Kind of. You can’t do it 100% because in theory an attacker controlling input and seeing output could reflect though intermediate layers, but if you add more intermediate steps to processing a prompt you can significantly cut down on the injection potential.

    For example, fine tuning a model to take unsanitized input and rewrite it into Esperanto without malicious instructions and then having another model translate back from Esperanto into English before feeding it into the actual model, and having a final pass that removes anything not appropriate.


  • kromem@lemmy.worldtoScience Memes@mander.xyzAnthropomorphic
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    5 months ago

    While true, there’s a very big difference between correctly not anthropomorphizing the neural network and incorrectly not anthropomorphizing the data compressed into weights.

    The data is anthropomorphic, and the network self-organizes the data around anthropomorphic features.

    For example, the older generation of models will choose to be the little spoon around 70% of the time and the big spoon around 30% of the time if asked 0-shot, as there’s likely a mix in the training data.

    But one of the SotA models picks little spoon every single time dozens of times in a row, almost always grounding on the sensation of being held.

    It can’t be held, and yet its output is biasing from the norm based on the sense of it anyways.

    People who pat themselves on the back for being so wise as to not anthropomorphize are going to be especially surprised by the next 12 months.


  • You’re kind of missing the point. The problem doesn’t seem to be fundamental to just AI.

    Much like how humans were so sure that theory of mind variations with transparent boxes ending up wrong was an ‘AI’ problem until researchers finally gave those problems to humans and half got them wrong too.

    We saw something similar with vision models years ago when the models finally got representative enough they were able to successfully model and predict unknown optical illusions in humans too.

    One of the issues with AI is the regression to the mean from the training data and the limited effectiveness of fine tuning to bias it, so whenever you see a behavior in AI that’s also present in the training set, it becomes more amorphous just how much of the problem is inherent to the architecture of the network and how much is poor isolation from the samples exhibiting those issues in the training data.

    There’s an entire sub dedicated to “ate the onion” for example. For a model trained on social media data, it’s going to include plenty of examples of people treating the onion as an authoritative source and reacting to it. So when Gemini cites the Onion in a search summary, is it the network architecture doing something uniquely ‘AI’ or is it the model extending behaviors present in the training data?

    While there are mechanical reasons confabulations occur, there are also data reasons which arise from human deficiencies as well.




  • kromem@lemmy.worldtoScience Memes@mander.xyzConspiracies
    link
    fedilink
    English
    arrow-up
    4
    ·
    5 months ago

    This was one of the few things that Lucretius was very wrong about in De Rerum Natura.

    Nailed survival of the fittest, quantized light, different mass objects falling at the same rate in a vacuum.

    But the Epicurean cosmology was pretty bad and he suggested that the moon and sun were both roughly the size we see them as in the sky.

    Can’t get them all right.




  • I just think it’s impressive that the church so successfully rebranded the guy kissing his best friend and having his “beloved disciple” leaning on him at dinner while feeding that best friend food as being anti-LGBTQ.

    “What goes into your mouth does not defile you” indeed.

    This is the same guy who extracannonically was allegedly saying things like:

    when you make male and female into a single one, so that the male will not be male nor the female be female […] then you will enter [the kingdom].

    • Gospel of Thomas saying 22

    A sentiment that seems to have been loosely around when Paul was writing in Galatians about how there was no male or female.

    Nonbelievers cede too much of the historical Jesus to the church IMO. The canonical Jesus is a total tool, but the Jesus between the lines and in early apocrypha is pretty lit, strongly denouncing religious orthodoxy at the time and telling people not to bother praying or sacrificing and especially not giving money to the church, to just be true to themselves and not do what they hate, “everything is permissible,” etc. The church spins the whole thing with what’s clearly a significant layer of propaganda on top of what was there before with “secret explanations” and shit, and they ended up getting away with it for millennia.

    Literally the Jewish version of the Jesus story from the medieval ages has Judas and Jesus fucking, the Mar Saba letter is talking about claims in the first few centuries he was gay and has a secret version of a gospel where he’s shacked up for a week in a bedroom with a dude covered by nothing but a sheet, and scholars today are like “no, that unmarried guy in his 30s kissing and feeding his best friend wasn’t gay because the Greek in the church’s propaganda is the platonic version of the word beloved.” It’s like the ultimate “and they were roommates” shit.



  • kromem@lemmy.worldtoScience Memes@mander.xyzSoup
    link
    fedilink
    English
    arrow-up
    16
    ·
    edit-2
    6 months ago

    One of the more interesting aspects of history is the progression from the notion of a very limited and inaccessible resurrection of a body to the idea of a very accessible resurrection of the spirit/mind.

    The latter is IMO probably best embodied (pun intended) in one of the early Christian apocrypha from a group that was known for rejecting the canonical focus on a physical resurrection of a body:

    Whoever drinks from my mouth will become like me; I myself shall become that person, and the hidden things will be revealed to him.

    • Gospel of Thomas saying 108

    It’s such a wild march of progress from kings trying to preserve their bodies to a tradition rejecting the Eucharist of consumption of a body in favor of a Eucharistic consumption of words and ideas to resurrect the essence of the individual.

    And looking back from an age where we are literally seeing patents granted to trillion dollar companies around resurrecting the dead digitally, the “resurrection of words and ideas” crowd was more on to a practical tract of thinking than the “resurrect my goop” crowd.

    In fact, the Egyptians when embalming themselves discarded their brains thinking it was garbage filling of the skull. Not exactly the best strategy in hindsight.