There are several products that will convert rust, though you have to remember that will only do what is on the surface, it is not a cure all or stop all. Do a search on rust converters on the internet and do a little homework on which fits your needs.
Since you do not want to remove the rust completely and only want to slow it down, this is what I would recommend.