If you want to override the language of the Glassfish 4 Server itself, you can add the following option to the JVM options of the domain:
You can add it to the domain.xml directly or you can open the admin console, go to the configuration pane, open the server-config, JVM-settings and then the JVM-option tab.
