Are AI systems limited in their ability to learn/incorporate new information?

This past week Nature magazine published an article at https://doi.org/10.1038/s41586-024-07711-7  titled "Loss of Plasticity in Deep Continual Learning" by Shibhansh Dohare and others.

It basically claims that AI systems can not go on learning new things forever.

In contrast, the Human brain can continually learn and incorporate new information, over the whole of it's "defect free" lifetime.

The paper suggests a possible way of correcting this basic AI learning problem by resetting certain weights used in its neural network. This effectively introduces noise into the system.

Peter Brooks

Palm Bay Florida 

Parents
  • In contrast, the Human brain can continually learn and incorporate new information, over the whole of it's "defect free" lifetime.

    In my personal experience at least, at my age, incorporating new information seems to be at the expense of loosing old stuff... so potentially no net gain.

       - Andy.

  • Hello Andy:

    I am probably the oldest member on this thread, so as indicated in yesterdays Guardian (there was an article about getting feedback about aging from old folk) , you don't have to believe them when they talk about aging:-

    As I get older the problem is not losing old stuff, it's that more time is needed to recall pieces of the data.

    I will give you an example - Mike Lynch death this week on his boat reminded me of the death of Maxwell on this boat - tied indirectly to Prince Andrew. I could not remember Maxwell's first name (Robert) until 2 hour later when it just dropped into my main memory.

    Peter Brooks

    Palm Bay 

Reply
  • Hello Andy:

    I am probably the oldest member on this thread, so as indicated in yesterdays Guardian (there was an article about getting feedback about aging from old folk) , you don't have to believe them when they talk about aging:-

    As I get older the problem is not losing old stuff, it's that more time is needed to recall pieces of the data.

    I will give you an example - Mike Lynch death this week on his boat reminded me of the death of Maxwell on this boat - tied indirectly to Prince Andrew. I could not remember Maxwell's first name (Robert) until 2 hour later when it just dropped into my main memory.

    Peter Brooks

    Palm Bay 

Children
No Data