• QuaternionsRock@lemmy.world
    link
    fedilink
    English
    arrow-up
    9
    arrow-down
    10
    ·
    7 months ago

    I mean, it’s not shit at everything; it can be quite useful in the right context (GitHub Copilot is a prime example). Still, it doesn’t surprise me that these first-party LLM benchmarks are full of smoke and mirrors.

      • QuaternionsRock@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        8
        ·
        7 months ago

        Not to be confused with Microsoft Copilot, which I have yet to find a use for. Do you not like GH Copilot either?

        • FredFig@awful.systems
          link
          fedilink
          English
          arrow-up
          16
          ·
          7 months ago

          Eclipse could generate templates for me, and I think we collectively agreed to stop using Eclipse like 20 years ago, so why are we trying to bring it back.

          • froztbyte@awful.systems
            link
            fedilink
            English
            arrow-up
            9
            ·
            edit-2
            7 months ago

            hey hey hey, don’t forget about android studio! that kept inflicting the pain of eclipse on many for years!

      • self@awful.systems
        link
        fedilink
        English
        arrow-up
        21
        ·
        7 months ago

        it’s always fucking “boilerplate” with these assholes, isn’t it? I don’t know how so many people got into this field and didn’t figure out the template, snippet, or macro engines in their editors

        • froztbyte@awful.systems
          link
          fedilink
          English
          arrow-up
          12
          ·
          7 months ago

          “hey copilot buddy please write me a http server for a guestbook application I can demo on my blog”

      • QuaternionsRock@lemmy.world
        link
        fedilink
        English
        arrow-up
        15
        arrow-down
        9
        ·
        7 months ago

        That GitHub Copilot and friends are useful? I would argue that their utility is rather subjective, but there are indications that it improves developer productivity.

        I’m unsure if you’ve used tools like GH Copilot before, but it primarily operates through “completions” (“spicy autocorrect” in its truest form) rather than a chatbot-like interface. It’s mostly good for filling out boilerplate and code that has a single obvious solution; not game-changing intelligence by any means, but useful in relieving the programmer of various menial tasks.

        May I ask, what evidence are you hoping to see in particular?

        • Krauerking@lemy.lol
          link
          fedilink
          English
          arrow-up
          13
          ·
          7 months ago

          I too want a taxi driver that doesn’t know how to drive a car but can adjust the little TV content in the back.
          Psh I mean all he has to do is step on the gas pedal and the car does all the work anyways right? I’m glad he doesn’t have to think to much about so he has more time to get the thermostat just right.

            • o7___o7@awful.systems
              link
              fedilink
              English
              arrow-up
              4
              ·
              edit-2
              7 months ago

              The moral equivalent of “peril-sensitive shades” will be the killer app for augmented reality headsets.

          • LargeMarge@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            5
            arrow-down
            7
            ·
            7 months ago

            I mean…yea? That’s kind of the point. It’s not driving, it’s the copilot. You’re the one driving, and it will get the thermostat right because you’re busy operating the vehicle and want to keep your attention on the road. That seems useful to me.

            If you already have an idea of the code you want to write and start typing it, Copilot can help auto complete so you can focus on actually solving whatever problem you’re working on instead of searching for the correct syntax online. I understand shitting on AI is fun and there’s plenty of valid criticisms to be made, but this is actually kind of useful.

            • self@awful.systems
              link
              fedilink
              English
              arrow-up
              12
              ·
              7 months ago

              how could we possibly be critical of the technology that at best replicates basic editor functionality (templating, syntax completion), outputs wildly incorrect code, and burns rainforests?

              • LargeMarge@sh.itjust.works
                link
                fedilink
                English
                arrow-up
                3
                arrow-down
                5
                ·
                edit-2
                7 months ago

                I’m not saying you can’t be critical of it, but templating and syntax completion is in fact useful. Suggesting incorrect code is obviously bad, but all of this stuff is still relatively new and I’m sure it’ll get better with time. Can’t we at least try to be a little optimistic about what this stuff is capable of when we give our criticisms, instead of having knee jerk reactions that make this out to be the harbinger of the apocalypse?

                Side point to address the linked article: yes, computing systems use energy. If our energy grid is overly reliant on the burning of fossil fuels that release harmful emissions, that doesn’t mean we need to stop the advancement of our computers. It means we need to stop using so much fossil fuels in our grid.

                • self@awful.systems
                  link
                  fedilink
                  English
                  arrow-up
                  14
                  ·
                  7 months ago

                  syntax completion has existed since 1957, and templating (or macros that implement templates) has been in editors long enough I don’t think anyone remembers when they got added (but here’s TECO (1962) anyway. the implementations of these things that run inside your editor are lightweight, predictable, and don’t increase carbon emissions by 30%, and it’s really weird that you’re in this thread cosplaying as a programmer but somehow don’t know basic shit about how code’s written, actually??? why is that, I wonder.

                  yes, computing systems use energy

                  come the fuck off it. so much of computer science involves studying algorithmic efficiency, something you just tried to talk past. it’s how we know that the regular expressions and push-down automata we implement in editors to do fast efficient syntax completion are a better fucking idea than using some shit that does the same thing less reliably and consumes so much fucking energy doing it that it increases greenhouse emissions by 30 fucking percent

                  • V0ldek@awful.systems
                    link
                    fedilink
                    English
                    arrow-up
                    9
                    ·
                    7 months ago

                    FPGA systems researchers: with this clever trick we can make the chip have 36% lower surface area and use 14% less energy!

                    Worst people you know: haha gpus go brrrrrrrrrrr

                • YouKnowWhoTheFuckIAM@awful.systems
                  link
                  fedilink
                  English
                  arrow-up
                  14
                  ·
                  7 months ago

                  but all of this stuff is still relatively new and I’m sure it’ll get better with time

                  What is the exact point of taking this attitude? Anybody who cares to look knows exactly what’s wrong with this stuff. It’s an astonishingly, and I mean “astonishing” as in “actually beyond ordinary human comprehension” as in “literally awe-inspiring”, wasteful means (whether your energy source is fossil fuels or solar!) of doing - at the absolute outside best - extraordinarily basic shit. Every single day the window of useful applications and potential improvements narrows incredibly rapidly, and the people who are fundamentally steering the whole programme are proven liars and scam artists, and proven beyond any shadow of a doubt at that?

                  Who cares if it’s relatively new, or if there’s room for mild-mannered optimism? What practical teeth does that argument have? What purpose does it actually serve beyond satisfying a basically shallow political impulse to moderate perceivedly heightened emotive responses to these incredibly stark facts?

                  The only actually reasonable response to this farrago is full-throated opposition to every element of the whole show which is either a lie or covering for a lie, which is virtually every single element. If all that you’re left with is “hey, transformers are pretty cool, and I look forward to seeing how they contribute in their own partial way to our collective technical means of saving the planet, and incidentally anti-trust legislation should put people like Altman behind bars for the rest of their lives” then so be it! That’s a far more even-handed and fundamentally sensible response than blithely insisting that the occasional trinket has room for improvement - in fact if you’re liberal-minded it’s the essential output of any sensible thoughts on how to maintain a democratic society.

                • V0ldek@awful.systems
                  link
                  fedilink
                  English
                  arrow-up
                  10
                  ·
                  edit-2
                  7 months ago

                  this stuff is still relatively new and I’m sure it’ll get better with time

                  We’ll engrave it on LLMs’ tombstone, right next to blockchain and its “it’s still early”.

                • 200fifty@awful.systems
                  link
                  fedilink
                  English
                  arrow-up
                  10
                  ·
                  7 months ago

                  yes, computing systems use energy. If our energy grid is overly reliant on the burning of fossil fuels that release harmful emissions, that doesn’t mean we need to stop the advancement of our computers. It means we need to stop using so much fossil fuels in our grid.

                  Now where have I heard something like this before? I’m trying to think of something, but I just can’t quite seem to remember…

                  • LargeMarge@sh.itjust.works
                    link
                    fedilink
                    English
                    arrow-up
                    3
                    arrow-down
                    5
                    ·
                    7 months ago

                    Nope, I just feel like there’s a lot of reactionary content out there about AI. It’s still in it’s infancy and a lot of the tech bros behind these companies are full of shit and over hype it, which is exactly why I was also skeptical about ChatGPT passing the bar exam when it initially happened. But even with that said, it’s still a tool that can be applied in useful ways, such as giving suggestions for code or correcting grammar as you type.

                    There’s just no nuance in these discussions and you’re a perfect example of that

            • froztbyte@awful.systems
              link
              fedilink
              English
              arrow-up
              10
              ·
              7 months ago

              “Ah but see, there is no agency, there is merely emergent behaviour! It is none of our choices that drive this, but merely the ideas some have had that drive this engine of our doom. Alas, we can do nothing about this outcome!”

              • LargeMarge@sh.itjust.works
                link
                fedilink
                English
                arrow-up
                3
                arrow-down
                5
                ·
                7 months ago

                I have no idea what you mean by this comment. All I’m saying is that an auto complete feature when writing code is useful, which is largely what this was designed for.

        • self@awful.systems
          link
          fedilink
          English
          arrow-up
          13
          ·
          7 months ago

          May I ask, what evidence are you hoping to see in particular?

          holy fuck shut the fuck up