Mmm... if it goes down, then motor is good... so it has to be the switch or the relay that controls that window. I would start out by taking the front switch apart and clean all 6 contacts inside it...
Or you can try to figure out which relay by pulling them out and swapping them.