Hi Jord,
It seems that you are using the same select page for widgets → reference selector and input reference set selector.
When you try to fix one error, it starts conflicting with the other. Try to create separate select page for a reference selector and input reference set selector and the deadlock should be resolved.
Hope this helps!