When the AI bubble pops, what will remain? Cheap GPUs at firesale prices, skilled applied statisticians looking for work, and open source models that already do impressive things, but will grow far more impressive after being optimized:

  • cubism_pitta@lemmy.world
    link
    fedilink
    English
    arrow-up
    22
    arrow-down
    1
    ·
    2 days ago

    Local models are actually pretty great! They are not great at everything… but for what most people are using LLMs for they do a fine job.

    Thats from llama3.1:8b and the answer is decent, it took about 20seconds to generate my answer and used no more power than if I were to play a video game for the same amount of time.

    • sugar_in_your_tea@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      1
      ·
      8 hours ago

      Boiling time isn’t related to original potato size, it’s related to the size of pieces you cut. So the first half is irrelevant and the second half is overly verbose.