Over just a few months, ChatGPT went from correctly answering a simple math problem 98% of the time to just 2%, study finds. Researchers found wild fluctuations—called drift—in the technology’s abi…::ChatGPT went from answering a simple math correctly 98% of the time to just 2%, over the course of a few months.

  • Boinketh@lemm.ee
    link
    fedilink
    English
    arrow-up
    22
    ·
    1 year ago

    I have noticed that it’s gotten less useful as a syntax helper. I hope something better comes along.

    • aquinteros@lemmy.world
      link
      fedilink
      English
      arrow-up
      13
      arrow-down
      1
      ·
      1 year ago

      idk what you guys mean but GitHub copilot still works absolutely well, the suggestions are fast and precise, with little Tweeks here and there… and gpt4 with code interpreter are absolute game changers … idk about basic chatgpt 3.5 turbo though

      • danwardvs@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        8
        ·
        1 year ago

        Github Copilot is a bit different, it’s powered by OpenAI Codex which is trained on all public repos. And yes, it’s quite effective!

        • mb_@lemmy.world
          link
          fedilink
          English
          arrow-up
          4
          ·
          1 year ago

          Public GPL or public MIT? So there’s a chance of you adding GPL code to your private repository and having a very messy licensing?

          • danwardvs@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            2
            ·
            1 year ago

            My understanding is that it’s all publicly viewable code on Github regardless of licence. The legality of the training data and usage is hotly debated. Although you can get it to generate entire code blocks, my use and where I find it effective is finishing lines of code based on context of what I’m writing, so it’s “filling in the blanks” around my code so to say.

            • mb_@lemmy.world
              link
              fedilink
              English
              arrow-up
              2
              ·
              1 year ago

              It is not because tone can see that one can use it.

              Open source does not mean “free to repurpose”

      • Boinketh@lemm.ee
        link
        fedilink
        English
        arrow-up
        6
        ·
        1 year ago

        I heard they put copilot behind a paywall. Does the free version still hold up?

        • datavoid@lemmy.ml
          link
          fedilink
          English
          arrow-up
          3
          ·
          1 year ago

          There was a free version?

          I’ve been paying for it for a few months now - it makes some stupid suggestions occasionally and you definitely have to check everything, but can hugely increase productivity.

          I use vscode as my notepad, so whenever I need to make a list or write something, it will automatically give suggestions that I can choose to include. Has been useful for finding new programs, products and services as well.

          Note it will complain if you directly ask it a non coding related question, however.

        • aquinteros@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 year ago

          I use the payed version, it’s about 10usd a month I believe I don’t know if there is a free version still