Bob,
To see a water heater on the exterior of an older home around here (So Cal) is very, very common. I agree not the best set up but very common. They make metal enclosures (that are crap) for such installations. Of the hundreds maybe thousands I have seen none are installed correctly, saw three last week. They can be installed outside here because our weather is much more mild than elsewhere in the country.