If you spend a lot more money on your vinyl playback equipment, eventually you'll start to hear your vinyl sounding better than high bit rate MP3. It probably won't really be better, but the law of fulfilled expectations says that you will believe it sounds better.
I spent a lot of time and money chasing the ephemera of vinyl perfection, and I've never been satisfied. I've visited a lot of acquaintances with multiple thousands of dollars in vinyl playback equipment. These guys (yes, all men) were rapturous in describing their bliss: "So much better than digital" "Anyone who's heard my system can never be satisfied with anything else" "I showed my iPod-loving brother-in-law what an inferior toy he had compared to true music on vinyl" etc.
I'd have to say candidly that I never heard a single vinyl playback system that was even close to the fervent evangelizing of its owner. Some of it sounded pretty good, and I'm willing to be open to the possibility that somewhere such an experience does exist, but if it's that hard to find and that difficult to achieve, then what's the point?
I stopped saying anything other than "That sounds great" after a while, because anytime I'd mention that the highs sounded clipped or the bass muddy, or the mids artificially bloated and distorted, or the rumble intrusive, or the pops and clicks distracting, the listening would be interrupted. Then there would follow a frantic and often lengthy recalibration of the system, cleaning of the media, checking of the electrical system, replacement of cables, pads, absorbers, etc. All the while, the owner would be commenting on how important it was to do this and that regularly and repeatedly if you wanted the pure vinyl experience; otherwise, I surmised one was not dedicated enough to perfection to spend more time tweaking the system to get a few minutes of bliss than to spend actual time listening.
In a word, the whole pursuit was goofy.
Chris is right, it does sound different. To some that difference is a sound they prefer, and I have no gripe with personal preference. However, I do think vinyl is misrepresented as some kind of sonic nirvana that one achieves with enough ritualistic devotion, meditation, faith, and sacrificial offerings ($$$$) and that those who don't get it just haven't achieved enlightenment yet.
Perhaps true enlightenment is knowing and admitting that it does not exist.