• Gladaed@feddit.org
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    9
    ·
    1 day ago

    How would it do that?

    It’s a set of inputs that generates and output, once per execution. Integrating it into an infrastructure that allows it to start external programs and scheduling really isn’t on the LLM.

    You cannot start a timer without having a timer, too. And LLMs aren’t brings who exist continually like you and me so time exists on a different, foreign dimension to an LLM.

    • YesButActuallyMaybe@lemmy.ca
      link
      fedilink
      English
      arrow-up
      10
      arrow-down
      2
      ·
      1 day ago

      You attach an epoch timestamp to the initial message and then you see how much time has passed since then. Does this sound like rocket surgery?

      • stringere@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        6
        ·
        edit-2
        16 hours ago

        How does the LLM check the timestamps without a prompt? By continually prompting? In which case, you are the timer.

        • YesButActuallyMaybe@lemmy.ca
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          7
          ·
          1 day ago

          It’s running in memory… I’m not going to explain it, just ask an AI if it exists when you don’t prompt it

          • Gladaed@feddit.org
            link
            fedilink
            English
            arrow-up
            10
            ·
            23 hours ago

            That’s not how that works.

            LLMs execute on request. They tend not to be scheduled to evaluate once in a while since that would be crazy wasteful.

            • stringere@sh.itjust.works
              link
              fedilink
              English
              arrow-up
              2
              ·
              17 hours ago

              Edit to add: I know I’m not replying to the bad mansplainer.

              LLM != TSR

              Do people even use TSR as a phrase anymore? I don’t really see it in use much, probably because it’s more the norm than exception in modern computing.

              TSR = old techy speak, Terminate and Stay Resident. Back when RAM was more limited (hey and maybe again soon with these prices!) programs were often run once and done, they ran and were flushed from RAM. Anything that needed to continue running in the background was a TSR.

              • Gladaed@feddit.org
                link
                fedilink
                English
                arrow-up
                1
                ·
                10 hours ago

                Please tell me why you believe that the LLM keeps being executed on your chat even when the response is complete.

                  • Gladaed@feddit.org
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    ·
                    9 hours ago

                    Ohh, that makes sense.

                    I wouldn’t have gotten that abbreviation without the explainer. Good on you for explaining it. Never heard it working in tech.