And so how should one respond differently to a blinker or a brake? Either one means "this car is slowing down" so its pretty much a moot point, especially since both rear lamps (and the CHMSL) are going to be simultaneously visible 99% of the time.
OTOH, seeing amber in limited visibility conditions implies "approaching vehicle" which is flat-out false in the case of amber rear turn signals. Meaning you have to rely on simultaneously seeing headlamps or taillamps to resolve THAT ambiguity. You're just trading one ambiguity for another, and I'd argue that the "signal or brake" ambiguity isn't particularly dangerous since you should assume that the car is slowing to a near-stop (at least) under either condition. The fact of the matter is that BOTH systems work perfectly well, both have done so for over 50 years, and I think you'd be hard-pressed to find a statistically different number of collisions based on the color of the rear turn signals, except for the "duelling reds" design you mentioned before. (That's your open invitation to prove me wrong.) :-)