Sounds like a pretty well running car overall with just some infrequent idle & starting issues, so thats really good. It took me a long time to tune for reliable starts where my plugs stay perfect and there's never smoke. I was going to ask about WRD but see you checked that. I have my cold start solenoid at the back of the injection pump disconnected too, as I think many of us do, especially in warmer climates, although it might still help you on very cold days in NJ, but thats not your problem here.
So, yes, maybe another thing to check is the thermo-time-switch. I wonder if the hot-start problem is really a warm-start problem? ...only happens if the engine is partially warmed but still below the temperature (~35C) that the switch is designed to stop triggering the CSV, and then maybe it is still pushing a small bit of raw fuel into the intake and making it too rich to start easily (ie, flooded) which could explain why you come back in 20 minutes and it starts right up, although it would be cooler then too and the WRD would also be in a different place, so hard to know for sure. Multiple things are going on but I have heard from at least 2 sources who have put a manual cut-out switch in their CSV circuit to be able to force it off and prevent warm start flooding problems, so clearly that is a real "thing", although I haven't experienced it myself. Given that is a thermo mechanical switch that heats a physical element up to close the ground for a certain time vs. temperature, it's easy to imagine it being out of calibration, especially if it's original. Fortunately that is something you can bench test with warm water and a thermometer just like you did with the WRD.
So combine that with hot and cold idle RPMs not perfectly in spec and you might have a situation where under certain edge cases you have issues. If it were me, remember I'm not a mechanic, since its a pain to pull the thermo-time switch out, I'd first go carefully through the idle tuning guide on this site and try to get the cold and hot idles a little closer to spec, but don't make huge changes since you have an overall well running engine. Just getting the hot idle down to ~750 RPM may buy you the mixture margin you need. Also in going through the very systematic idle tuning process you may figure out why your cold idle is low and that could help too.
The only other thing I can think of to check is timing, but it sounds like its in a happy place with good cold starts and good power so dont want to fix something thats not broke.
Thats it, I'm out of ideas, maybe some other vets on the site will chime in. Good luck ! and hey, if the pagoda continues to give you the cold shoulder just go fire up the shelby ;-)