A router table would be nice to have, but not necessarily for speaker building. Cheap router tables tend to give poor results as well. It may be that this one is good though.
For speaker cutouts and edge round-overs I much prefer a fixed base router. Skil is owned by Bosch and this set shares many of the same features as the Bosch set that is double the price except that it's MIC, just like every other brand except Bosch.
I like BOSCH cause I have one and it has been good to me for years. I got one with both the fixed and plunger head that can run a 1/4" or 1/2" router bit. run 1/2" router bits if you have the option between the two sizes. I used a Jasper Jig with the plunger head for the circles.... The plunger head ensures the 1/4" spiral bit goes straight into the face of the baffle.
I like to run a fixed base on the baffle when I've attached it to the speaker. I cut the baffle 1/8" or so bigger then needed. I center the baffle on the speaker and then have a bit of the baffle edge extending beyond the speaker box. I run a flush cut router bit to get things nice. I then do another pass with a round over bit. Both the round over bit and the flush cut bit have nice bearings on on the tip to keep things flush.