AFAIK the delete icon calls the default delete behaviour and is not changable.
We use a listview underneath the filedroppers to show the files and implement our own (delete) logic.
To prevent the “default” cards from being shown we hide them (when the upload is done) by adding a css class to the filedropper widget .