Tested this type of button configuration in 7.15.1 and this works as expected.
The issue seems to be caused by something else, do you have any events running on the entity that use the isNew() function, or associated entities?
If not then try to remove the button and add it again, as a simple test proofs that the button's default behavior with the mentioned settings works fine.