Thousands of people in the UK drive this way when in Europe mainland. Haven't heard news reports of thousands being killed on holiday. Drive within the limitations - if you can't see far enough ahead to overtake, don't.
A friend of mine has moved to France and still insists on driving his RHD car in a LHD country. I've done it many times, with no ill effect.