Exactly. Currently, the global reference size is determined by the height of the preview panel which is also not ideal.
Ideally, in both the preview panels the user should be able to zoom in/out (as on the iPhone/iPad GlyphsViewer App), as well as, be able to set a specific size.
Related post: Feature request: Zoom in Preview Panel - #7 by gor.jious