Task Difficulty Aware Parameter Allocation & Regularization for Lifelong Learning (CVPR 2023)