Generally, I would agree completely. I have driven my car in some pretty cold weather and well below freezing. Aluminium will transfer heat very effectively but it will also cool just as well. That long plenum chamber doesn't get very warm towards the throttle body end in really cold weather.
Actually, now that I remember it the vent line coming from the valve cover froze up and the crankcase pressure pushed oil out of the fitting for the tach cable. When I stopped, I had oil all over the place in my engine bay. After I put the throttle body heater on I've never had a problem like that again. I washed the engine at a car wash which quickly thawed all of my icing problems.
Late cars have a plastic pipe for venting the valve cover but early cars have metal ones. The metal ones can fill up with rust and crud which is what happened to my car. With little to no opening it easily froze up once the throttle valve iced over.