• FauxLiving@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 days ago

      I’m not even sure what you mean by equivalent. Is an airplane equivalent to aerospace engineering? They’re two different things.

      AI models, the neural network ones, are essentially just a bunch of tensor multiplication. Tensors are a fundamental part of linear algebra and I hope I don’t have to keep explaining the joke.

      The point is that no amount of being angry and toxic on the Internet will make AI disappear.

      In addition, what most people are complaining about (the exploitative way that AI is being used) is not an AI problem, it is a capitalism problem. So, not only is the rage and anger useless but it is pointed at the wrong target.

      • JiveTurkey@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 day ago

        Saying people should stop complaining about something shitty just because you think it will continue to exist is ridiculous. Saying that current AI models are just a bunch of tensor multiplication seems like a gross over simplification of systems that are increasingly harder to understand. Linear algebra isn’t new but this isn’t just linear algebra. People should keep bitching about AI until it either dies or finds an entirely new business model based on not being pieces of shit.

        • FauxLiving@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 day ago

          People should keep bitching about AI until it either dies or finds an entirely new business model based on not being pieces of shit.

          How can AI die? What does that even mean?

          It’s math. You can write the algorithms on a napkin from memory. It cannot ‘die’. You’re tilting at windmills, there’s nothing to kill.

          You’re mad at the people who are using the productivity gains resulting from this new technology and eliminating jobs for people.

          That isn’t an AI problem. The same thing happens every time there is a new productivity saving device. It doesn’t result in the workers earning more money from increased productivity, it results in a huge amount of people getting fired so profits can go up.

          You’re not mad at AI, you’re mad at capitalism but it sounds like you lack the perspective to understand that.

          • JiveTurkey@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            edit-2
            23 hours ago

            It’s funny that you think these things are operating on napkin math. I guess it takes tens of thousands of GPUs and months of compute time to work out some napkin math. All of these years of AI research resulted in some napkin math that we were missing all along and now the work is over. What a ridiculous thing to say. Even if you know the algorithms used you still need a mountain of GPU compute and a few power plants to make them work. It’s not just math or if it is, we don’t understand the math. Math is deterministic. These models are not deterministic, an input does not always produce the same output and you can’t feed a response backwards through a model to produce the query. We struggle to make even remotely predictable changes to a model when it does something we don’t like. We didn’t discover math and then AI came packaged with it. The AI industry can die like any other. Using your logic, anyone and everyone can build nukes, they’re just math and physics and the materials (like GPUs and Power) are easy to come by. We can’t erase the knowledge so let’s all sit back and enjoy the fallout.

            Capitalism undoubtedly makes the situation worse but AI is a threat even without capitalism. So far they’re making life more expensive in multiple ways for all of us with no real benefit for their existence.

            • FauxLiving@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              ·
              20 hours ago

              It’s funny that you think these things are operating on napkin math. I guess it takes tens of thousands of GPUs and months of compute time to work out some napkin math.

              You’re confusing a lot of things and it sounds like when you say ‘AI’ you mean ‘ChatGPT’ or generative LLM/Diffusion models. Because those large models are the only ones that use a large amount of computer resources. That doesn’t represent the entirety of neural network based machine learning (AI)

              My phone uses an LLM for spellcheck, it even runs fine tuning (the thing that you’re referring to that requires ‘tens of thousands of GPUs’) on the phone processor. Writing and training text recognition AI from scratch is literally an exercise for Computer Science students to do on their personal computer. AI running object detection models runs on tiny microprocessors inside of doorbells.

              My response was that you cannot eliminate AI because the algorithms that are required to build it are already known by millions of experts who can re-create it from scratch.


              All of these years of AI research resulted in some napkin math that we were missing all along

              As much as you’re trying to be sarcastic. Yes, that is correct.

              This is not unusual in science, here’s some other napkin formulas that required years, decades and centuries to discover.

              E=MC2 – Years of knowledge and research to discover how mass and energy were related

              √-1 = i – 1800 years is how long it took for this to be accepted

              F = ma – Newton’s force equation

              e + 1 = 0 – Euler’s Identity

              E = hf – Plank’s discovery describing how photon energy links to frequency.

              etcetc.


              What does ‘AI dying’ even look like to you? If you were the dictator of Earth, how would you eliminate the knowledge from the minds of millions of experts across the world?


              It’s not just math or if it is, we don’t understand the math. Math is deterministic. These models are not deterministic, an input does not always produce the same output and you can’t feed a response backwards through a model to produce the query. We struggle to make even remotely predictable changes to a model when it does something we don’t like.

              Once again you’re confusing topics and also definitions. Determinism, interpretability and explainability are different things.

              Neural networks are completely deterministic. A given input will always return the same output.

              You’re probably referring to the trick that the LLM chatbots use where they take the output of the the model, which is a list of tokens with a score of which is most likely, and randomly select a token from that list before feeding it back into the model. This is a chatbot trick, it doesn’t happen in the model.

              No machine learning model uses randomness during inference. Often people pass in random noise so the output varies, but if you pass in the same random noise then you get the same output.

              ‘We don’t know how it works’ isn’t exactly true. There’s a lot of work in this field (https://en.wikipedia.org/wiki/Explainable_artificial_intelligence) and there’s nothing fundamentally unknowable about these systems.

              The AI industry can die like any other.

              Yes, like I said, ‘The AI industry’ that produced generative LLMs and diffusion models is what you’re upset about, you’re upset that capitalists are using AI to fire workers and destroy jobs.

              You’re not upset that we’ve discovered the ability to create universal approximation functions or use machines to learn from data.

              You’re mad at capitalism, not AI.

              Using your logic, anyone and everyone can build nukes, they’re just math and physics and the materials (like GPUs and Power) are easy to come by. We can’t erase the knowledge so let’s all sit back and enjoy the fallout.

              This isn’t an argument, this is: https://en.wikipedia.org/wiki/Reductio_ad_absurdum

              I said you can’t eliminate the knowledge of AI from society since anyone with a laptop can train one from scratch and the knowledge to do so is available to everyone. The knowledge for making nuclear weapons was also not eliminated despite being far more dangerous and widely condemned.

              Also, irrelevant to my point but, in what world are the materials to make nuclear weapons easy to come by?

              but AI is a threat even without capitalism. So far they’re making life more expensive in multiple ways for all of us with no real benefit for their existence.

              No real benefit? Once again, you seem to be talking about generative AI. That’s a product, created by capitalists, using AI. It isn’t the entirety of the AI field, it isn’t even the field with the most AI workers.

              AI is used in science and has facilitated incredible discoveries already.

              AlphaFold revolutionized structural biology by predicting the shape of every known protein which has massively accelerated drug discovery. I’m not sure if you’re aware but there are now TWO AIDS vaccines in human trials and the researchers use machine-learning models to mine clinical data in order to spot patterns in immune responses leading promising therapies.

              AI is being used to plan, execute and interpret lab work, this is a tedious and laborious task that requires a highly trained person, typically a grad student. This isn’t something that you can scale up 100x or 1000x because you can’t magic 1000 graduate students into existence. Now you can use AI to do the tedious work and a grad student can now run multiple times are labs which are at the heart of almost every scientific discovery.

              Diagnostic AI, which is more objectively more accurate than human experts, is used to annotate diagnostic images in order to indicate to a doctor areas to examine. This results in lower error rates and earlier detection than human-only review.

              It’s discovered new plasma physics which are key for having working fusion power. (https://www.pnas.org/doi/10.1073/pnas.2505725122)

              So, while you may not think these are worth the downsides, it’s disingenuous to say that there has been no benefit.

              • JiveTurkey@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                ·
                14 hours ago

                No one complaining about AI is talking about regular neural networks. I thought that distinction was clear especially in the context of this article. These huge data centers with thousands of GPUs aren’t being built for simple neural networks. The complaints are valid and they should keep being voiced at every opportunity.