Don’t use anything abrasive. The aluminium is anodised to give it a hard wearing surface. If you brush through that ultra thin layer your mast may look nice at first but it will pretty soon look worse then before. The best way to clean and maintain aluminium is with cleaning ethanol. (The cheap kind, not the kind you drink, that would be a waste). Other than that leave it and accept the marks as the marks of an experienced boat/sailor.
On the other hand, metal, and aluminium is a metal, can be painted. Maybe you should look at a metal paint system? I have no experience to share in that field.