Formerly u/CanadaPlus101 on Reddit.

  • 2 Posts
  • 199 Comments
Joined 3 years ago
cake
Cake day: June 12th, 2023

help-circle
  • Sure, like assuming Islam is a region isn’t racist. At least the people that want to bomb (the fictional city of) Agrabah don’t pretend to care about Muslims.

    FWIW Iranians don’t even love being lumped in with the Arabs. Afghanistan is culturally Persian, and closer to the central Asian steppe homelands and south Asia than to the Middle East.






  • Yeah. Unless they mean “the exact minute before Justin Trudeau took office”, I’m struggling to picture that moment. If you go back past the first Trudeau that people hate, you hit the worker-populist UFA/SoCred era, and the era that fueled it right before. And then that’s all the history there is.

    100% chance this imaginary version of Alberta is also devoid of old but now unfashionable bits of Prairie life, and saturated with red American lifestyle imports, instead.




  • That the exact same piece of art will have a wildly different value depending on who’s seen to have made it, is true. And that goes for different humans, as well as for human vs. AI. Usually artists find that part undesirable, though. It’s supposed to be a skill they personally have and not just about connections and clout.

    You’re probably right that people aren’t going to stop wanting Banksy, even if AI can do an equally good Banksy.

    BTW, photography did kill painting, as it was. Painting portraits was like a steady trades job before - people wanted to be remembered and seen by future generations, and with no cameras that was the only way. Afterwards, it just becomes a form of fine art. A lot of the anger now is because something similar is happening to, like, graphic designers.


  • Well, what is creativity? Does it have to be transcendent? Or does it just mean original and useful or coherent, like in the paper? If it’s the latter, a collection of cells can be creative, and an extremely large mathematical system embodied in a GPU could also, potentially, be creative. It’s just a matter of being able to reach the creative concept (probably somewhat randomly), without outputting incoherent garbage first.

    Isn’t that what coming up with an idea feels like? Wandering through the space of concepts until everything clicks together all the sudden?

    This goes towards answering your other reply, too. I have no idea what it’s “like” to be an LLM, and how much it differs from “being” nothing, but if experience (for the sake of argument) is necessary to output decent art, then isn’t an AI replacing artists evidence it has an experience? That is something that has empirically happened, at least for some kinds of artists and to some degree.






  • Ah, but if there’s no random element to a human cognition, it should produce the exact same output time and time again. What is not random is deterministic.

    Biologically, there’s an element of randomness to neurons firing. If they fire too randomly, that’s a seizure. If they don’t ever fire spontaneously, you’re in a coma. How they produce ideas is nowhere close to being understood, but there’s going to be an element of an ordered pattern of firing spontaneously emerging. You can see a bit of that with imaging, even.

    Anyways, however we eventually create an artificial mind, it will not be with a large language model; by now, that much is certain.

    It does seem to be dead-ending as a technology, although the definition of “mind” is, as ever, very slippery.

    The big AI/AGI research trend is “neuro-symbolic reasoning”, which is a fancy way of saying embedding a neural net deep in a normal algorithm that can be usefully controlled.


  • On actual mental illness specifically, as opposed to just “weirdness” in general, I have no hard data. If it’s caused at the physiological level, it makes sense that it wouldn’t follow the same pattern. You can of course name a bunch of mentally ill but prominent thinkers and artists from the past, but there’s almost certainly a lot of neglect of base rate going on there.

    It’s worth noting production LLMs choose randomly from a significant range of tokens they deem fairly likely, as opposed to choosing the most likely one every time. If they were too conservative with it, they too would fall on the near side of that curve.


  • A link to the paper itself, if like me you have a math background, and are wondering WTF that means and how you measure creativity mathematically. Or for that matter what amateur-tier creativity is. Unfortunately, it’s probably too new to pirate, if you don’t have a subscription to the Journal of Creative Behaviour.

    At least according to the article, he argues that novelty and correctness are opposite each other in an LLM, which tracks. The nice round numbers used to describe that feel like bullshit, though. If you’re metric boils down to a few bits don’t try and pad it by converting to reals.

    That’s not even the real kicker, though; the two are anticorrelated in humans as well. Generations of people have remarked at how the most creative people tend to be odd or straight-up mentally ill, and contemporary psychology has captured that connection statistically in the form of “impulsive unconventionality”. If it’s asserted without evidence that it’s not so in “professional” creative humans, than that amounts to just making stuff up.