I think your best option here is to replace the ReferenceSet Selector with a datagrid (constrained on the reference set) and a listening dataview that displays an external link to the object's link.
(This does give some extra overhead if your refset selector has new/select buttons as you'll have to create these with microflows and extra datagrid forms.)