check to see what color your anti freeze is ,if its red or green then go check the other stuff ,but if it is rusty looking then your heater core is probably partially clogged ,probably what you need to do is get your coolant system flushed out and refilled ,I have seen this happen before many times and it is amazing how well your heater system works afterward ,myself I get my system flushed out about every 2 years to keep the system working at peak efficiency and to make sure your coolant have the proper lubrication or you will be eventually replacing your water pump too, this is one of those things that most people look at as "if the coolant full then it is fine" and they don't do anything until a major failure happens and this is one of those things that will help your engine last ,monro I believe can do a flush for around 50 bucks for you which is cheap insurance