A broomstick, a variety of sandpaper, and some double stick tape would be how I'd go about it. Fasten the stick down somehow, stick the sandpaper to the stick, and get to sanding.
Start with the heavy grit, then use the finer stuff to progressively polish the cut.
I'd mark the centerline of the grip somehow, and check regularly to ensure I'm not going off center.