The cross encoder re-ranked results are much better for more distant queries. It does take more time with the cross-encoder re-ranking but it seems worth it to get more relevant results