Unfortunately it seems random as far as I can tell. The first time I was waiting for ages. When I was explaining it to someone else it started raining immediately. Also don't look for the actual rain drops (I usually don't see them) but the weather indicator on the mini-map.