This past week Nature magazine published an article at https://doi.org/10.1038/s41586-024-07711-7 titled "Loss of Plasticity in Deep Continual Learning" by Shibhansh Dohare and others.
It basically claims that AI systems can not go on learning new things forever.
In contrast, the Human brain can continually learn and incorporate new information, over the whole of it's "defect free" lifetime.
The paper suggests a possible way of correcting this basic AI learning problem by resetting certain weights used in its neural network. This effectively introduces noise into the system.
Peter Brooks
Palm Bay Florida