Natural Language Processing

The T5 multi-task transformer model pretrained on a wide array of tasks, fine-tuned for paraphrase generation while preserving performance on old tasks. Alleviated Catastrophic forgetting using EWC.