I guess you could trim an emery board down to fit in the smaller holes where your file won't fit but, personally, I wouldn't worry about it.

Who is going to notice?

I just sand the front a bit (and the back for the fuzzy's) and put on a finish. If you want the front to be a bit more glossy, rub the front with a square of brown paper sack and apply more finish.

Rog