Yes you can. Take a look at JsonDeserializer.java around line 115. The section that has a comment:
//ReferenceSet
could be wrapped in something like this:
if (!object.isNull(attr) && object.getJSONArray(attr).length() > 0) {
which would cause the deserializer to skip that null attribute and continue on.