The multimeter should be enough to tell you if the alternator is working properly.
Bear in mind, though, that a multimeter won't necessarily tell you if the battery is shagged. Shops that sell batteries have a special instument which measures fast discharge.