I guess you could trim an emery board down to fit in the smaller holes where your file won't fit but, personally, I wouldn't worry about it.
Who is going to notice?
I just sand the front a bit (and the back for the fuzzy's) and put on a finish. If you want the front to be a bit more glossy, rub the front with a square of brown paper sack and apply more finish.
Rog