Some people reported about this bug before you long time ago ([0.8.3.1] Sitting is breaking wearables offsets), also I asked Caboose about this bug and that’s what I got as respond.
It happens not only with glasses, but with almost every accessory item.