You can use the color filters, but it is a limited view of the overall color performance.
If a TV is set up correctly, you can use the blue filters with no problems and the other colors would be inherantly correct. This Samsung has oversaturated colors, and the secondary colors are affected greatly by the tint (hue) settings. So you might be setting the hue for blue correctly, but cyan, magenta and yellow will be off. Changing the color setting doesn't impact color saturation as much as it changes color brightness on this display, and because of this you need to compensate for it. That is why the color is more accurate near 40.
If you use the color filter, and color looks fine to you, then you can leave it there. If it appears too strong, then I would back it down somewhere between 40 and 50.