A quick look on Giant's website suggests they do for the current models so I am sure they do for your older one. Another possibility is a capacitor of some sort in there.
What happens if you try to switch the bike on with no battery fitted, does the display still light up?
Normal behaviour for...