Catastrophic forgetting. Don't worry. I am not talking about politics. Catastrophic forgetting is a “lovely” feature of deep neural networks. They overwrite old knowledge when learning new things. There are different ways to mitigate this, but the problem persists.
If this problem were…