上游任务 - 文本相似度
1. 孪生网络[1][2]
1. Siamese Recurrent Architectures[1]
2. Siamese Recurrent Networks [2]
Reference
[1] Siamese Recurrent Architectures for Learning Sentence Similarity
[2] Learning Text Similarity with Siamese Recurrent Networks
https://github.com/nlpyang/BertSum
https://github.com/google-research/bert/issues/164
Using Prior Knowledge to Guide BERT’s Attention in Semantic Textual Matching Tasks -2021