I built my table to my own needs. It seems that would be best.
I have a comfy office chair on wheels, with a back and arms. I sat in it and put my arms and hands at a comfortable height and measured. I got around 31-32". So I measured my scroll saw and subtracted from the total and got 24". I built the table to 24" high and mounted my saw and got the saw table top at 31-1/2 " PLUMB PERFECT!
So I say do what is comfortable for you! Sit in your chair that you want to use and measure.