Likely your coolant is low, very low. So with its absence, there is not enough of it to circulate to the thermostat at other parts it normally needs to flow to, and thus cool.
So absolutely fill it up before you do serious engine damage, since when there is no coolant going to the top of the engine, it can warp with the huge temp swings of when it DOES get coolant, VS when it doesn't.
Just buy typical pre-mixed coolant/anti-freeze, at any Canadian tire. Fill the coolant reservoir, drive it around for a block or two (so the radiator can suck in the coolant as needed) then top it off, you'll likely have to do this a few times until the radiator is full.
Failing this? its the temperature sending unit for the engine.
"The music business is a cruel and shallow money trench, a long plastic hallway where thieves and pimps run free, and good men die like dogs. There's also a negative side"