Welp, checked for C wire.
No connected C wire. But it's there. So I connected it to my existing thermostat. Connected it to furnace. It works!
Took forever to fish the wire out of the wall though. They wrapped the damn wire around like 10 times.
Humidifier has 24V as well, so this is going to be really straightforward.