After some more experimentation I found out how to do it. You have to use "System.Owner" or "System.changedBy" as the name of the reference when writing the join. Unfortunately this reference is not suggested by the autocomplete popup. It would be nice if it did.
Example:
FROM MyFirstModule.TestEntity AS te
INNER JOIN te/System.owner/System.User AS usr