I had a similar issue. Locally the glyphicons displayed fine, but when deployed on our Windows servers, they were missing everywhere in the app.
On Windows, the deployed app is fronted by IIS, and I added a MIME type font/woff2 for the file extension .woff2 in the MIME Types IIS configuration for the IIS website. This fixed the problem for us. I hope this helps.