If you have any more stubborn rust spots, I would try one of those green plastic domestic scouring pads as suggested above, (3M Scotchbrite or similar). I have an old bicycle that lives outside here and any rust gets a quick rub with a bit of that and a coating of WD40.
Anything more serious and you can buy small tubs of rust converter jelly in places like Homepro.