Cross encoders and bi-encoders. Cross encoders and bi encoders are two… | by Bhawana Prasain | Medium

However, cross encoders are slow if you need to compare thousands of sentences since they need to encode all the sentence pairs. On the other hand, bi encoders perform self-attention over the input and candidate label separately.