• Muehe@lemmy.ml
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    9 hours ago

    You might be a few years behind. We have robots outpacing human performance in specific tasks using neural networks.

    Might well be behind here, but to my knowledge we don’t have a single robot outpacing a single human in most tasks. They don’t do one-shot learning from their mistakes, they don’t learn new movements randomly. Because most basically just use static weights when operating, because you don’t really want an industrial robot to get ideas. But even test systems that can learn usually just have an equivalent to the movement model of a brain, maybe a vision model, just like an LLM is just a language model. You would need a system that has all of those, plus the other brain areas, especially a prefrontal cortex like model for integration.

    I’m sure people are working on it, but I haven’t heard of anything successful yet. I imagine there might be a being like that in secret which is currently tortured in some billionaires tech dungeon. Poor thing.

    Also, LLMs can perform on tasks they weren’t explicitly trained for. This line is not as well defined as you make it sound.

    Yeah but that’s coincidental. It’s the model weights, prompt, and the RNG aligning. They can mock reasoning, because they do it by what they always do, predict more text, but it’s not like this has any effect on themselves. They aren’t really understanding a mistake when you point it out and growing neurons and synapses, i.e. they won’t have different model weights the next time you ask the same question. They can only really change when the powers that be release an update, which includes new training data, and hence model weights.