Just had the issue I came across three years ago...auwtssj.
Problem: the mapping a reference set on an import mapping cannot be set to empty.
Ugly solution: Use find object (by key) on the object above the reference set, in this MF, set the reference set to empty
Idea solution: Add the option the empty the reference set before setting the new associations on the mapping of the reference set.