If it is a minimal effort to dull it slightly, then it would be best to do it before the side rails etc are mounted. Its not really a "blinding" gloss Matt, and it depends on the environmentt it is going into. If you are happy, leave it.
It is much better than it was before
