Can someone explain to me about the human brain or something? I've always been under the impression that it's kinda like the neural networks AIs use but like many orders of magnitude more complex. ChatGPT definitely has literally zero consciousness to speak of, but I've always thought that a complex enough AI could get there in theory
We don't know all that much about how the human brain works.
We also don't know all that much about how computer neural networks work (do not be deceived, half of what we do is throw random bullshit at a network and it works more often than it really should)
Therefore, the human brain and computer neural networks work exactly the same way.
Yeah there's some ideas about there clearly being a difference in that the brain isn't feed-forward like these algorithms are. The book I Am a Strange Loop is a great read on the topic of consciousness. But I bet these models hit a massive plateau as the pump them full of bigger, shitter data. Who knows if we'll ever achieve any actual parity between human and ai experience.
at some point they started incorporating recursive connection topologies. but the model of the neuron itself hasn't changed very much and it's a deeply simplistic analogy that to my knowledge hasn't been connected to actual biology. I'll be more impressed when they're able to start emulating the structures and connective topologies actually found in real animals, producing a functioning replica. until they can do that, there's no hope of replicating anything like human cognition.
I suppose I already figured that we can't make a neural network equivalent to a human brain without a complete understanding of how our brains actually work. I also suppose there's no way to say anything certain about the nature of consciousness yet.
So I guess I should ask this follow up question: Is it possible in theory to build a neural network equivalent to the absolutely tiny brain and nervous system any given insect has? Not to the point of consciousness given that's probably unfalsifiable, also not just an AI trained to mimic an insect's behavior, but a 1:1 reconstruction of the 100,000 or so brain cells comprising the cognition of relatively small insects? And not with an LLM, but instead some kind of new model purpose built for this kind of task. I feel as though that might be an easier problem to say something conclusive about.
The biggest issue I can think of with that idea is the neurons in neural networks are only superficially similar to real, biological neurons. But that once again strikes me as a problem of complexity. Individual neurons are probably much easier to model somewhat accurately than an entire brain is, although still nowhere near our reach. If we manage to determine this is possible, then it would seemingly imply to me that someday in the future we could slowly work our way up the complexity gradient from insect cognition to mammalian cognition.
Is it possible in theory to build a neural network equivalent to the absolutely tiny brain and nervous system any given insect has?
IIRC it's been tried and they utterly failed. part of the problem is that "the brain" isn't just the central nervous system -- a huge chunk of relevant nerves are spread through the whole body and contribute to the function of the whole body, but they're deeply specialized and how they actually work is not yet well studied. in humans, a huge percentage of our nerve cells are actually in our gut and another meaningful fraction spread through the rest of the body. basically, sensory input comes extremely preprocessed to the brain and some amount of memory isn't stored centrally. and that's all before we even talk about how little we know about how neurons actually work -- the last time I was reading about this (a decade or so ago) there was significant debate happening about whether real processing even happened in the neurons or whether it was all in the connective tissue, with the neurons basically acting like batteries. the CS model of a neuron is just woefully lacking any real basis in biology except by a poorly understood analogy.
I saw a lot of this for the first time during the LK-99 saga when the only active discussion on replication efforts was on r/singularity. For the past solid year or two before LK-99, all they'd been talking about were LLMs and other AI models. Most of them were utterly convinced (and betting actual money on prediction sites!) that we'd have a general AI in like two years and "the singularity" by the end of the decade.
At a certain point it hit me that the place was a fucking cult. That's when I stopped following the LK-99 story. This bunch of credulous rubes have taken a bunch of misinterpreted pop-science factoids and incoherently compiled them into a religion. I realized I can pretty safely disregard any hyped up piece of tech those people think will change the world.
While we're here, can I get an explanation on that one too? I think I'm having trouble separating the concept of algorithms from the concept of causality in that an algorithm is a set of steps to take one piece of data and turn it into another, and the world is more or less deterministic at the scale of humans. Just with the caveat that neither a complex enough algorithm nor any chaotic system can be predicted analytically.
I think I might understand it better with some examples of things that might look like algorithms but aren't.
Thanks for the help, but I think I'm still having some trouble understanding what that all means exactly. Could you elaborate on an example where thinking of something as an algorithm results in a clearly and demonstrably worse understanding of it?
Okay, I think I get it now. I see how one could really twist something like your evolution example every which way to make it look like an algorithm. Things like saying the process to crabs is prescribed by the environmental conditions selecting for crab like traits or whatever, but I can see how doing that is so overly broad as to be a useless way to analyze the situation.
One more thing: I don't know enough about algorithms to really say, but isn't it possible for an algorithm to produce wildly varying results from nearly identical inputs? Like how a double pendulum is analytically unpredictable. What's more, could the algorithmic nature of a system be entirely obscured as a result of it being composed of many associated algorithms linked input to output in a net, some of which may even be recursively linked? That looks to me like it could be a source of randomness and ambiguity in an algorithmic system that would be borderline impossible to sus out.
For the sake of argument, let’s be real generous with the terms “unambiguous”, “sequence”, “goal”, and “recognizable” and say everything is an algorithm if you squint hard enough.
when you soften these words, what you're left with is a heuristic - a method that occasionally does what you expect but that's underspecified. it's a decision procedure where the steps aren't totally clear or that sometimes arrives at unexpected results because it fails to capture the underlying model of reality at play.
That's pretty much the current thinking in mainstream neuroscience, becuase neural networks vaguely sort of mirror what we think at least some neurons in human brains do. The reality is nobody has any good evidence. It may be if ChatGPT get ten jillion more nodes it'd be like a thinking brain, but it's probably likely there are hundreds more factors involved than just more neurons.
Can someone explain to me about the human brain or something? I've always been under the impression that it's kinda like the neural networks AIs use but like many orders of magnitude more complex. ChatGPT definitely has literally zero consciousness to speak of, but I've always thought that a complex enough AI could get there in theory
Yeah there's some ideas about there clearly being a difference in that the brain isn't feed-forward like these algorithms are. The book I Am a Strange Loop is a great read on the topic of consciousness. But I bet these models hit a massive plateau as the pump them full of bigger, shitter data. Who knows if we'll ever achieve any actual parity between human and ai experience.
at some point they started incorporating recursive connection topologies. but the model of the neuron itself hasn't changed very much and it's a deeply simplistic analogy that to my knowledge hasn't been connected to actual biology. I'll be more impressed when they're able to start emulating the structures and connective topologies actually found in real animals, producing a functioning replica. until they can do that, there's no hope of replicating anything like human cognition.
deleted by creator
I suppose I already figured that we can't make a neural network equivalent to a human brain without a complete understanding of how our brains actually work. I also suppose there's no way to say anything certain about the nature of consciousness yet.
So I guess I should ask this follow up question: Is it possible in theory to build a neural network equivalent to the absolutely tiny brain and nervous system any given insect has? Not to the point of consciousness given that's probably unfalsifiable, also not just an AI trained to mimic an insect's behavior, but a 1:1 reconstruction of the 100,000 or so brain cells comprising the cognition of relatively small insects? And not with an LLM, but instead some kind of new model purpose built for this kind of task. I feel as though that might be an easier problem to say something conclusive about.
The biggest issue I can think of with that idea is the neurons in neural networks are only superficially similar to real, biological neurons. But that once again strikes me as a problem of complexity. Individual neurons are probably much easier to model somewhat accurately than an entire brain is, although still nowhere near our reach. If we manage to determine this is possible, then it would seemingly imply to me that someday in the future we could slowly work our way up the complexity gradient from insect cognition to mammalian cognition.
IIRC it's been tried and they utterly failed. part of the problem is that "the brain" isn't just the central nervous system -- a huge chunk of relevant nerves are spread through the whole body and contribute to the function of the whole body, but they're deeply specialized and how they actually work is not yet well studied. in humans, a huge percentage of our nerve cells are actually in our gut and another meaningful fraction spread through the rest of the body. basically, sensory input comes extremely preprocessed to the brain and some amount of memory isn't stored centrally. and that's all before we even talk about how little we know about how neurons actually work -- the last time I was reading about this (a decade or so ago) there was significant debate happening about whether real processing even happened in the neurons or whether it was all in the connective tissue, with the neurons basically acting like batteries. the CS model of a neuron is just woefully lacking any real basis in biology except by a poorly understood analogy.
deleted by creator
I saw a lot of this for the first time during the LK-99 saga when the only active discussion on replication efforts was on r/singularity. For the past solid year or two before LK-99, all they'd been talking about were LLMs and other AI models. Most of them were utterly convinced (and betting actual money on prediction sites!) that we'd have a general AI in like two years and "the singularity" by the end of the decade.
At a certain point it hit me that the place was a fucking cult. That's when I stopped following the LK-99 story. This bunch of credulous rubes have taken a bunch of misinterpreted pop-science factoids and incoherently compiled them into a religion. I realized I can pretty safely disregard any hyped up piece of tech those people think will change the world.
deleted by creator
While we're here, can I get an explanation on that one too? I think I'm having trouble separating the concept of algorithms from the concept of causality in that an algorithm is a set of steps to take one piece of data and turn it into another, and the world is more or less deterministic at the scale of humans. Just with the caveat that neither a complex enough algorithm nor any chaotic system can be predicted analytically.
I think I might understand it better with some examples of things that might look like algorithms but aren't.
deleted by creator
Thanks for the help, but I think I'm still having some trouble understanding what that all means exactly. Could you elaborate on an example where thinking of something as an algorithm results in a clearly and demonstrably worse understanding of it?
deleted by creator
Okay, I think I get it now. I see how one could really twist something like your evolution example every which way to make it look like an algorithm. Things like saying the process to crabs is prescribed by the environmental conditions selecting for crab like traits or whatever, but I can see how doing that is so overly broad as to be a useless way to analyze the situation.
One more thing: I don't know enough about algorithms to really say, but isn't it possible for an algorithm to produce wildly varying results from nearly identical inputs? Like how a double pendulum is analytically unpredictable. What's more, could the algorithmic nature of a system be entirely obscured as a result of it being composed of many associated algorithms linked input to output in a net, some of which may even be recursively linked? That looks to me like it could be a source of randomness and ambiguity in an algorithmic system that would be borderline impossible to sus out.
deleted by creator
also, the word they actually mean is heuristic.
deleted by creator
when you soften these words, what you're left with is a heuristic - a method that occasionally does what you expect but that's underspecified. it's a decision procedure where the steps aren't totally clear or that sometimes arrives at unexpected results because it fails to capture the underlying model of reality at play.
deleted by creator
deleted by creator
deleted by creator
deleted by creator
deleted by creator
deleted by creator
speaking of 4th dimensional processing, https://en.wikipedia.org/wiki/Holonomic_brain_theory is pretty interesting imo
deleted by creator
no because the human brain is far more complicated and we don't know how it works
That's pretty much the current thinking in mainstream neuroscience, becuase neural networks vaguely sort of mirror what we think at least some neurons in human brains do. The reality is nobody has any good evidence. It may be if ChatGPT get ten jillion more nodes it'd be like a thinking brain, but it's probably likely there are hundreds more factors involved than just more neurons.