• RedPander@lemmy.rogers-net.com
    link
    fedilink
    arrow-up
    1
    ·
    1 year ago

    Wild that it’s mentioned multiple times in here how the large data sets aren’t really an advantage. Reminds me of Nate Silver’s The Signal and the Noise. Sounds like Google and OpenAI have a lot of noise right now.

    • Communist@beehaw.org
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      It’s not, this method of analysis is terrible, they’re just asking gpt4 to grade the responses, not actually testing anything beyond that.

      • aponigricon@beehaw.org
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        That doesn’t necessarily invalidate the point they’re making. Other forms of analysis, strikingly, provide pretty much completely equivalent results.