I always thought the lack of brick here historically was due to a lack of material and availability of alternatives, like Killr' said - lumber and sandstone.
It's readily available in Toronto and you see it used extensively in even the crappiest areas and cheapest new suburbs, so I don't think it's a strictly cost, but more to do with local availability.