That's interesting. I had hoped that CoreVideo would be automatically offloading to the GPU, at least eventually. Is that not the case?
The CoreVideo could give you hardware scaling and colorspace conversion, but not the MPEG2/H.264 decoding acceleration. As far as I know, there is no open API to take advantage of the GPU hardware capabilities in Mac OS X.