Abstract: Bert pre-trained models have achieved significant success in the field of natural language processing. In text matching, the feature vectors extracted from text using Bert pre-trained models ...