ChatGPT can offer coding solutions, but its tendency for hallucination presents attackers with an opportunity. Here's what we learned.

From https://twitter.com/llm_sec/status/1667573374426701824

  1. People ask LLMs to write code
  2. LLMs recommend imports that don’t actually exist
  3. Attackers work out what these imports’ names are, and create & upload them with malicious payloads
  4. People using LLM-written code then auto-add malware themselves
  • haltowork@lemmy.fmhy.mlEnglish
    3·
    1 year ago

    Asking LLMs for code is fine, but it really needs proof reading to be worth anything. Could even ask it to proofread its own work.

    Also, never 3.5