What a heartbreaker! Wow, all that time and material wasted.
I would use a light sandpaper to smooth out the fibers. Then I would consider an airless spray gun (Wagner or other) for a smooth, flawless job; no lap marks and no fibers. Yes, it will require some good masking but it may be worth the trouble.