If you start in System.User, it has multiple owner-tables to all entities where the system member owner is saved. It's like a crossroads where the database doesn't know which road to take.
You can do it using OQL though:
SELECT DISTINCT u/id
FROM System.FileDocument f
INNER JOIN f/System.owner/System.User u