or Connect
AVS › AVS Forum › Video Components › Home Theater Computers › Mfusick's How to build an affordable 30TB Flexraid media server: Information Requested.!
New Posts  All Forums:Forum Nav:

Mfusick's How to build an affordable 30TB Flexraid media server: Information Requested.! - Page 57

post #1681 of 3346
Thread Starter 
I hear you on that biggrin.gif I usually do my ripping every once in a while and more than 1 at a time. I'd rather do it faster, less frequently wink.gif Having more than one drive really cuts down on the time it takes and well worth the effort if you have more than just a few to rip, or if it's something you will be constantly doing ! I agree with you 100% on that.

There is no reason why it won't do exactly like you want it to do. I think you should be happy.

For me it just comes down to the specifics that probably do not matter for many other people. I started out thinking I was going to do it like you want to do it; but then I realized my personality and laziness was a factor I had not considered. I actually enjoy talking about media organization and I am always curios to find better ways to do it. I do it a certain way now that I can try to explain: (feedback on how crazy I am ???? tongue.gif )

When I first started HTPC I did not have much media and I was starting out with little. It was pretty easy to get up and running and going. As my media collection grew I kept gaining more and more "categories" which are folders on my FLEXRAID server pool. Inside each of those folders is those items or the parts of that collections. For example I have a folder called "Non HD movies" which I place all my movies into that are not 720p or better, mostly DVD's for example. I have another folder called "BLURAY RIPS" which only contain pure BR rips with HD audio and subtitles, and no compression at all. Minimum files size is usually about 20GB for these. I also have a HD movies folder that has stuff that might be transcoded or not pure BR MKV quality. This is various stuff that might still be 720p or 1080p but it's lower bit rate or smaller file size. Often I keep the stuff I really care about in full quality, but some stuff for whatever reason I don't want to devote the space for. I also have folders for "Disney" which is basically disney cartoons or anything that might be kid related, I also have a "XMAS" folder that has Season Christmas time favorites, My wife loves TITANIC and has some sick obsession with it so I have a collection that is all about the sinking and story of the TITANIC. I also have "ISO" folder that I keep full ISO's inside in case I want to play it back with the disc menu and special features- rather than just the movie MKV like I have in the movie folders. I also have a "TV SHOWS" folder that is loaded with different TV SHOWS or series. I could go on.. but I think you get the idea right ?

Years later (today) my collection is pretty big. I have two hard drives worth of TV and two more worth of Bluray, I have another full of DVD's, and another full of other stuff. I have probably 15TB of media, perhaps more. Now that my collection is getting large and complicated I find it harder to manage and keep up with it like I did when I was starting out. So I prefer to ONLY allow and keep 100% completed and finalized/organized folders inside my collections. Otherwise it's a mess on my front end clients and looks crappy. Wife would complain to me "you need a cover art folder for this" etc... and it really subtracted from the HTPC media browsing experience IMO, which is something I like about HTPC as compared to putting in a disc or surfing TV channels.

My decision to ONLY allow completed folders into my collections basically stems from my personality and tendency- I often might throw in a disc and rip it but I might not get back to organizing and naming it or doing the mediacentermaster thing on it until a few days later. I like not only ripping a few at a time, but also organizing a few a time. This cuts down on my time I need to spend on organizing my media. That is a thorn in my side, as I love the benefits of a highly organized media collection, but I really don't want to have to do the work or constantly maintain it. So by doing it the way I do I am able to spend less time and effort on it- and I never have "incomplete" media in my library either. I only add it when it's complete, and I don't care if it sits on my desktop for a day or two until I get it added. I simply do it as I am allowed time. In reality I am constantly doing a little bit of media organization all the time, but it never is hard or time consuming or feels like a chore or something I need to do, or that I have been neglecting.

For this reason I do not rip directly to my server pool anymore, or ever want to rip on my server directly. I would rather rip on my workstation desktop which has a nice gaming mouse, keyboard, mousepad, large triple monitors, and robust performance HDD and CPU. The entire process is easier in every regard and brings me much more enjoyment than doing it directly on the server. I could not imagine doing it without multiple screens, large screens, high level of control and high level of performance. I would go nuts. Just a personality thing- I appreciate things that are optimized or better than they simply need to be. It bring me pleasure enjoy something that is really great, as opposed to just acceptable. I'm nearly certain I can rip, name, organize and finalize media much faster than your average HTPC person- I probably do twice as much in half the time doing it my way. But again- my way is not for everyone.

I attribute this to the same thing as if you own two cars, one really nice one and one everyday beater normal car. You would get used to driving the really nice car and prefer that each time you had to drive almost negating ever wanting to use the less good car. Or if you have two TV or theater systems, one really good sound with huge picture, and one kinda small with not so good sound (good is relative) - which would you rather watch your movies on ?? The better one- and thus the crappier one would get used less, or for less critical viewing.

My desktop is a 4770k with fast SSD, RAM, and a very fast scratch disk (dual seagate 7200 in RAID 0 with SSD cache) I have three monitors, the smallest is 23" Samsung 1080p. My main display is 1200p 26" and I really want a 2560 30" soon. My mouse pad is a $60 Razer metal mouse pad with a Razer gaming mouse - I use the control surface with a very high DPI sensitivity. I actually have two keyboards, One Cherry MX switched, and another for gaming Macros. I've taken a lot of effort into my chair height, desk, monitor location- and little stuff to really maximize my experience on my PC. Not only do I enjoy PC in general, but also HTPC and also gaming. I realize I might have a set up that is a little different or more advantageous than everyone, and it's a big part of the reason why I would rather use my desktop than my HTPC, or my laptop, or my server. I guess I could use the BR drive in my laptop pretty easily and rip directly to the server- but the reality is laptops sucks in comparision to how I do it. Just moving the stupid touchpad frustrates me trying to check boxed in MakeMKV and the small screen kills my eyes when working with such details tongue.gif I am not saying there is anything wrong with using a laptop either- just it's not for me wink.gif

The last reason I do it the way I do it ( I know I am weird... bring on the flames ) is because the level of difficulty increases with the growing size of media. I find that the performance of MediaCenterMaster over LAN on a very large collection (think multiple TB's per folder and hundreds of folders or thousands of files ) is rather poor. There is a lot of extra waiting time while it tries to read the library, and it's a mega pain just waiting for it to load up and scan up and populate the screen with everything. Also- there is a lot of extra work in ripping directly to my server. For instance- I have to constantly change the scan folders in MediaCentermaster from one collection to another depending on what I want to work on. IE: Changing from BR rips to TV shows etc...

What I do locally on my desktop is I have a folder on my scratch disc called "-mediacentermaster" I put the " - " before it because it makes it show up as the first folder on the drive, and also as the first library location. That makes it really easy to drag and drop stuff to that folder:



My Mediacentermaster is always pointed at this directory. I never change that. I instead find it better to move stuff to this folder to work on it- then I copy it to my server and then delete it from my scratch disc. Sometimes I find I might get hundred of GB of stuff before I bother moving it- other times I might do something more urgent and move it over all in one shot. When I rip, once the rip is done I just move the file to the mediacentermaster folder by drag and drop. Because it's all on the same hard drive and shares the same root it just repopulates and moves there. There is no waiting or any "copy paste" function that needs to happen. It is instant. I hate waiting for files to copy and paste - that is BS.

The really cool thing I do with my server is I open up a RDP session (which works really well thanks to SSD in my server OS smile.gif ) and use mediacentermaster installed on my server in one window on one monitor while I can use mediacentermaster installed on my desktop on another monitor. This allows me to do both MOVIES and TV SHOWS at the same time- cutting down my time spent biggrin.gif Basically my desktop MCM program stays permanently fixed on the "-mediamaster" scan folder and works on that. The MCM on my server stays permanently set on the TV SHOWS FOLDER on my server. Each instance of the application is set for the right mode; IE. Desktop is set on movie mode with movie settings and the server MCM is set on "TV MODE" with TV optimized settings. I find that dealing with TV shows separate from movies makes life easier- and results better. And doing is this way saves me tons of time everywhere.

I used to copy directly to my server pool but I found that unless I was copying directly into the media collection that entire process still required a copy and paste function to relocate so I might as well enjoy the benefits inherent in my workstations performance. Copy from my desktop to the collection, or from my server to the collection really makes no difference to me. It's all the same result. And this way I don't have to constantly point my MCM to different collections or folders, or change settings from TV to movies, to MISC etc... It's really a lot easier for me this way. But I doubt my way would be easier or better for anyone else.

Very much of this was an evolving process, and very much of this has resulted from a growing collection. I used to do it the "normal" way when my media collection was smaller but now that it's bigger I find it best to only work on the "new" material and leave the old stuff that is already 100% alone.
post #1682 of 3346
Quote:
Originally Posted by Mfusick View Post

I hear you on that biggrin.gif I usually do my ripping every once in a while and more than 1 at a time. I'd rather do it faster, less frequently wink.gif Having more than one drive really cuts down on the time it takes and well worth the effort if you have more than just a few to rip, or if it's something you will be constantly doing ! I agree with you 100% on that.

There is no reason why it won't do exactly like you want it to do. I think you should be happy.

For me it just comes down to the specifics that probably do not matter for many other people. I started out thinking I was going to do it like you want to do it; but then I realized my personality and laziness was a factor I had not considered. I actually enjoy talking about media organization and I am always curios to find better ways to do it. I do it a certain way now that I can try to explain: (feedback on how crazy I am ???? tongue.gif )

When I first started HTPC I did not have much media and I was starting out with little. It was pretty easy to get up and running and going. As my media collection grew I kept gaining more and more "categories" which are folders on my FLEXRAID server pool. Inside each of those folders is those items or the parts of that collections. For example I have a folder called "Non HD movies" which I place all my movies into that are not 720p or better, mostly DVD's for example. I have another folder called "BLURAY RIPS" which only contain pure BR rips with HD audio and subtitles, and no compression at all. Minimum files size is usually about 20GB for these. I also have a HD movies folder that has stuff that might be transcoded or not pure BR MKV quality. This is various stuff that might still be 720p or 1080p but it's lower bit rate or smaller file size. Often I keep the stuff I really care about in full quality, but some stuff for whatever reason I don't want to devote the space for. I also have folders for "Disney" which is basically disney cartoons or anything that might be kid related, I also have a "XMAS" folder that has Season Christmas time favorites, My wife loves TITANIC and has some sick obsession with it so I have a collection that is all about the sinking and story of the TITANIC. I also have "ISO" folder that I keep full ISO's inside in case I want to play it back with the disc menu and special features- rather than just the movie MKV like I have in the movie folders. I also have a "TV SHOWS" folder that is loaded with different TV SHOWS or series. I could go on.. but I think you get the idea right ?

Years later (today) my collection is pretty big. I have two hard drives worth of TV and two more worth of Bluray, I have another full of DVD's, and another full of other stuff. I have probably 15TB of media, perhaps more. Now that my collection is getting large and complicated I find it harder to manage and keep up with it like I did when I was starting out. So I prefer to ONLY allow and keep 100% completed and finalized/organized folders inside my collections. Otherwise it's a mess on my front end clients and looks crappy. Wife would complain to me "you need a cover art folder for this" etc... and it really subtracted from the HTPC media browsing experience IMO, which is something I like about HTPC as compared to putting in a disc or surfing TV channels.

My decision to ONLY allow completed folders into my collections basically stems from my personality and tendency- I often might throw in a disc and rip it but I might not get back to organizing and naming it or doing the mediacentermaster thing on it until a few days later. I like not only ripping a few at a time, but also organizing a few a time. This cuts down on my time I need to spend on organizing my media. That is a thorn in my side, as I love the benefits of a highly organized media collection, but I really don't want to have to do the work or constantly maintain it. So by doing it the way I do I am able to spend less time and effort on it- and I never have "incomplete" media in my library either. I only add it when it's complete, and I don't care if it sits on my desktop for a day or two until I get it added. I simply do it as I am allowed time. In reality I am constantly doing a little bit of media organization all the time, but it never is hard or time consuming or feels like a chore or something I need to do, or that I have been neglecting.

For this reason I do not rip directly to my server pool anymore, or ever want to rip on my server directly. I would rather rip on my workstation desktop which has a nice gaming mouse, keyboard, mousepad, large triple monitors, and robust performance HDD and CPU. The entire process is easier in every regard and brings me much more enjoyment than doing it directly on the server. I could not imagine doing it without multiple screens, large screens, high level of control and high level of performance. I would go nuts. Just a personality thing- I appreciate things that are optimized or better than they simply need to be. It bring me pleasure enjoy something that is really great, as opposed to just acceptable. I'm nearly certain I can rip, name, organize and finalize media much faster than your average HTPC person- I probably do twice as much in half the time doing it my way. But again- my way is not for everyone.

I attribute this to the same thing as if you own two cars, one really nice one and one everyday beater normal car. You would get used to driving the really nice car and prefer that each time you had to drive almost negating ever wanting to use the less good car. Or if you have two TV or theater systems, one really good sound with huge picture, and one kinda small with not so good sound (good is relative) - which would you rather watch your movies on ?? The better one- and thus the crappier one would get used less, or for less critical viewing.

My desktop is a 4770k with fast SSD, RAM, and a very fast scratch disk (dual seagate 7200 in RAID 0 with SSD cache) I have three monitors, the smallest is 23" Samsung 1080p. My main display is 1200p 26" and I really want a 2560 30" soon. My mouse pad is a $60 Razer metal mouse pad with a Razer gaming mouse - I use the control surface with a very high DPI sensitivity. I actually have two keyboards, One Cherry MX switched, and another for gaming Macros. I've taken a lot of effort into my chair height, desk, monitor location- and little stuff to really maximize my experience on my PC. Not only do I enjoy PC in general, but also HTPC and also gaming. I realize I might have a set up that is a little different or more advantageous than everyone, and it's a big part of the reason why I would rather use my desktop than my HTPC, or my laptop, or my server. I guess I could use the BR drive in my laptop pretty easily and rip directly to the server- but the reality is laptops sucks in comparision to how I do it. Just moving the stupid touchpad frustrates me trying to check boxed in MakeMKV and the small screen kills my eyes when working with such details tongue.gif I am not saying there is anything wrong with using a laptop either- just it's not for me wink.gif

The last reason I do it the way I do it ( I know I am weird... bring on the flames ) is because the level of difficulty increases with the growing size of media. I find that the performance of MediaCenterMaster over LAN on a very large collection (think multiple TB's per folder and hundreds of folders or thousands of files ) is rather poor. There is a lot of extra waiting time while it tries to read the library, and it's a mega pain just waiting for it to load up and scan up and populate the screen with everything. Also- there is a lot of extra work in ripping directly to my server. For instance- I have to constantly change the scan folders in MediaCentermaster from one collection to another depending on what I want to work on. IE: Changing from BR rips to TV shows etc...

What I do locally on my desktop is I have a folder on my scratch disc called "-mediacentermaster" I put the " - " before it because it makes it show up as the first folder on the drive, and also as the first library location. That makes it really easy to drag and drop stuff to that folder:



My Mediacentermaster is always pointed at this directory. I never change that. I instead find it better to move stuff to this folder to work on it- then I copy it to my server and then delete it from my scratch disc. Sometimes I find I might get hundred of GB of stuff before I bother moving it- other times I might do something more urgent and move it over all in one shot. When I rip, once the rip is done I just move the file to the mediacentermaster folder by drag and drop. Because it's all on the same hard drive and shares the same root it just repopulates and moves there. There is no waiting or any "copy paste" function that needs to happen. It is instant. I hate waiting for files to copy and paste - that is BS.

The really cool thing I do with my server is I open up a RDP session (which works really well thanks to SSD in my server OS smile.gif ) and use mediacentermaster installed on my server in one window on one monitor while I can use mediacentermaster installed on my desktop on another monitor. This allows me to do both MOVIES and TV SHOWS at the same time- cutting down my time spent biggrin.gif Basically my desktop MCM program stays permanently fixed on the "-mediamaster" scan folder and works on that. The MCM on my server stays permanently set on the TV SHOWS FOLDER on my server. Each instance of the application is set for the right mode; IE. Desktop is set on movie mode with movie settings and the server MCM is set on "TV MODE" with TV optimized settings. I find that dealing with TV shows separate from movies makes life easier- and results better. And doing is this way saves me tons of time everywhere.

I used to copy directly to my server pool but I found that unless I was copying directly into the media collection that entire process still required a copy and paste function to relocate so I might as well enjoy the benefits inherent in my workstations performance. Copy from my desktop to the collection, or from my server to the collection really makes no difference to me. It's all the same result. And this way I don't have to constantly point my MCM to different collections or folders, or change settings from TV to movies, to MISC etc... It's really a lot easier for me this way. But I doubt my way would be easier or better for anyone else.

Very much of this was an evolving process, and very much of this has resulted from a growing collection. I used to do it the "normal" way when my media collection was smaller but now that it's bigger I find it best to only work on the "new" material and leave the old stuff that is already 100% alone.

Holy **** bro. That post is a 50pg thread by itself. Excellent, very high quality post.
post #1683 of 3346
Didn't use the IPhone on that one
post #1684 of 3346
I do everything on my desktop as well, I then move the completed files to the movie server that resides in the nice cool basement smile.gif For series sets I load three discs at a time and rip to ISO then go do other things, then when I have time to sit down and actually work with them it becomes a much faster process.

Bill
post #1685 of 3346
OK. So I am home. I decided to reboot the server, and the pool started up just fine. Odd.....

HOWEVER, the "Server Folders" are still showing as "missing" when I look at them in the Dashboard. mad.gif

Oh, my XBox 360 HD-DVD drive was here waiting for me. I have it plugged in to my desktop (not the server) and I am ripping a movie with MakeMKV. Pretty slow over USB, but that is OK. It is 1:00am and I am tired. I will let it finish whilst I sleep.
post #1686 of 3346
Did you setup the shares through FlexRAID?
I always had to do that, otherwise it wouldn't find them because the pool does load too late for Windows itself.
post #1687 of 3346
No. I left the shares on the server side of things. The shares are the default ones that WHS sets up.

The shares are the default ones that show up under the Server Folders and Hard Drives icon in the Dashboard :
Documents
Music
Pictures
Recorded TV
Videos

I changed them all to be on the Pool drive, and when I "recreate the missing folder" it know that they are supposed to be on the pool drive and they recreate each time, but that is a manual process that I am going through.

Maybe there is a way to disable these "default" server shares and then I can just create my own?


On a positive note, I successfully ripped my first HD-DVD using the XBox 360 drive. I am going to keep running through those for a little while even though they take longer while I get the server ironed out.
post #1688 of 3346
Quote:
Originally Posted by nickbuol View Post

No. I left the shares on the server side of things. The shares are the default ones that WHS sets up.

The shares are the default ones that show up under the Server Folders and Hard Drives icon in the Dashboard :
Documents
Music
Pictures
Recorded TV
Videos

I changed them all to be on the Pool drive, and when I "recreate the missing folder" it know that they are supposed to be on the pool drive and they recreate each time, but that is a manual process that I am going through.

Maybe there is a way to disable these "default" server shares and then I can just create my own?


On a positive note, I successfully ripped my first HD-DVD using the XBox 360 drive. I am going to keep running through those for a little while even though they take longer while I get the server ironed out.

Why aren't you building the shared folder structure within FlexRAID?
post #1689 of 3346
I'm working on it. I created a "Movies" folder and shared it from within FlexRAID just fine, however all of the "built in" WHS 2011 ones are still there.

Current state of things.

FlexRAID is starting and running just fine. I changed nothing, so maybe I was just experiencing some Windows update mayhem or something last weekend.
I an ripping my 3rd HD-DVD right now with just the movie and the highest level of audio (HD audio). Things seem to be going OK and I am making sure that they get named something meaningful and to a standard for later on. Not sure if I should be grabbing 2 audio streams (HD and not HD) but I think that I am fine for what I plan to do.
I created, as mentioned above, the Movies folder and share on my pool drive just fine
I moved the other shares that WHS 2011 auto-creates and doesn't want to let go of, back to the O/S drive just to get it to stop showing errors in the Dashboard all of the time.

I want to hide those shares and still get WHS to not error out. I want to get rid of the ones marked with a red 'X' as they are created by the server and the server is only happy with them on the SSD. As you see, the Movies one shows up fine from my client PC. It is the FlexRAID one.

I would eventually want to create a FlexRAID version of the Music one though. I just haven't played around with these yet.


I am going to try to just simply "unshare" those via the WHS "Share and Storage Management" to see what it does about it.
Edited by nickbuol - 9/20/13 at 10:09am
post #1690 of 3346
You should be able to just move the WHS default shares to the pool using the dashboard. I did this (on WS2012E but should be the same) and it worked fine.
post #1691 of 3346
Well, those stupid shares are gone and don't auto-create, but the Dashboard is still squawking about missing shares which generates a "Critical Error".

Here is what I see:


and when I click on the Critical Error notification icon


I mean, technically it LOOKS the way I want it to from a client end, and the Movies are on the FlexRAID pool, but the error is annoying in the Dashboard.
post #1692 of 3346
Quote:
Originally Posted by politby View Post

You should be able to just move the WHS default shares to the pool using the dashboard. I did this (on WS2012E but should be the same) and it worked fine.

When I move them to the pool, they show up as "missing" still until I manually "recreate" them using the "Recreate Share" option or whatever in the Dashboard. The folders are there, as are my test files, but it just doesn't recreate the share itself.

Plus, I really don't want any "Documents," Recorded TV," "Videos," or "Pictures" shares. Just Movies (which I have now) and a Music one on the FlexRAID pool. I went into FlexRAID and created a Music share on the pool drive, and it shared just fine outside of WHS's management. Maybe I just need to ignore the errors in the Dashboard???
post #1693 of 3346
Thread Starter 
Oh I hate the WHS screens and the "connector" I used them on my first build but not on my rebuild. Works wonderful without.
post #1694 of 3346
You can just simply click on 'Ignore this alert' and it will take care of the critical error. I plan to create my own shares on the pool too and simply not use the WHS-created ones. The WHS shares are only there to use with the RWA and built-in media streaming features, Since I have other software I will use for streaming I just simply deleted the WHS shares and turn off the alert.
post #1695 of 3346
Won't the error come back every reboot? Maybe that won't be a problem once I get things all settled and don't reboot as often.
post #1696 of 3346
The error will show in the list (grayed out) but it won't trigger off the alert in the Dashboard since it would have been disabled.
post #1697 of 3346
Perfect. Thanks all.
post #1698 of 3346
I'm back with my next 2 questions. First up... Backups!

I have a 1TB external hard drive that I would like to use for both my server backup AND some backups of those digital photos and videos. These will NOT need to be shared, so having them in the "backup" format is fine.

I have been able to set the external drive as either one or the other (server backups OR client backups). As soon as I select the drive for server backups, it is no longer viewable inside Windows Explorer. If I set it as a client backup location, then I can't select it for the server backups. Seems silly, but I am starting to see a continual trend with WHS 2011 where Microsoft thinks that they are being helpful by locking certain things down to a specific way of doing it.

Q1) Can both client and server backups reside on the same drive?


Next question. I've been ripping some HD-DVDs (with what I am finding is so far a 50/50 success rate). I need to try a blu-ray yet, but when I play back the HD-DVD .MKV, my primary desktop can't keep up and things just get jumpy and audio/video gets out of sync. Clearly this is able to be run on a less powerful machine as most HTPCs have less horsepower than my computer (not that it is super-awesome, but well above specs I see elsewhere for HTPCs).

Q2) Is there an issue with HD-DVDs that when they get ripped with MakeMKV the encoding is problemsome? Is it the VC-1 encoding? Can I even get HD audio from a HD-DVD if I need to convert it after I rip it? A friend of mine said to just go to the video store and rent all of the HD-DVDs that I have but on blu-ray and rip those, but 1) that isn't technically legal/ethical, 2) that costs money. He said "time is money." rolleyes.gif

***EDIT:
Do I even really **need** server backups?
Edited by nickbuol - 9/20/13 at 9:05pm
post #1699 of 3346
Quote:
Originally Posted by nickbuol View Post

I'm back with my next 2 questions. First up... Backups!

Q2) Is there an issue with HD-DVDs that when they get ripped with MakeMKV the encoding is problemsome? Is it the VC-1 encoding? Can I even get HD audio from a HD-DVD if I need to convert it after I rip it? A friend of mine said to just go to the video store and rent all of the HD-DVDs that I have but on blu-ray and rip those, but 1) that isn't technically legal/ethical, 2) that costs money. He said "time is money." rolleyes.gif

***EDIT:
Do I even really **need** server backups?

All my MKVs used to run great, but lately they take a long time to load. But no stuttering. What codecs are you using? Try converting one to a m2ts using tsMuxerR. Windows likes this container a lot more than MKV. It is still the same lossless video and audio streams, just a different container. Xbox extenders play them much easier than MKVs, also.
post #1700 of 3346
How do I know that I am picking the right one in MakeMKV when it shows multiple long files sets?

For example, here is Battle LA. The top 3 on the list as you can see are 27.4GB. They have pretty much the same audio/subtitle options. The only difference I see is the "segment map" is slightly different for each of them. And then there is the 4th option which is smaller in size. I've seen a number of blu-rays with more than 1 choice that is the same size but different segment map.


@ Wilky13, I will check into that this weekend. There is a guy that I work with that was telling me that he uses .M2TS for all of his rips, but he seemed to just pick that without any real research he said, so I never looked further into it. I will see what the differences are and maybe run a conversion or two.

I do wonder if maybe it is my codecs. I have quite a few loaded on my computer, but nothing very recently updated. All a couple of years old.
post #1701 of 3346
I figure this way I would have essentially the drive pooling, but with the fast, safe back end of ZFS. 29.gif
post #1702 of 3346
Quote:
Originally Posted by nickbuol View Post

How do I know that I am picking the right one in MakeMKV when it shows multiple long files sets?

For example, here is Battle LA. The top 3 on the list as you can see are 27.4GB. They have pretty much the same audio/subtitle options. The only difference I see is the "segment map" is slightly different for each of them. And then there is the 4th option which is smaller in size. I've seen a number of blu-rays with more than 1 choice that is the same size but different segment map. image (Click to show)

@ Wilky13, I will check into that this weekend. There is a guy that I work with that was telling me that he uses .M2TS for all of his rips, but he seemed to just pick that without any real research he said, so I never looked further into it. I will see what the differences are and maybe run a conversion or two.

I do wonder if maybe it is my codecs. I have quite a few loaded on my computer, but nothing very recently updated. All a couple of years old.

Expand the playlist so we can see what is in them. Check the timestamps. Check the segments.
post #1703 of 3346
I am out of town for the weekend, but when I expand them, they all show what seems to be the same 12 or whatever audio tracks, and the same large number of subtitles. The only thing that I saw different was the segments or whatever. Most were the same with just one or two different numbers in the sequence. I didn't look for a date/time unfortunately. And this isn't for every blu-ray. A lot of them are just one main choice with MakeMKV set to ignore anything less than 60 minutes in length.

At first I thought that maybe the movie(s) had a theatrical and extended edition on the same disc, or maybe a regular and an IMAX version for movies like Barman Begins, but nope....
post #1704 of 3346
Quote:
Originally Posted by itznfb View Post

Expand the playlist so we can see what is in them. Check the timestamps. Check the segments.

Like' itznfb' has said you only way to tell is to check the segments until you find the difference.

The only difference on Battle LA is that the film title is different on each of the playlists - the middle segment is slightly different (foreign title on 2 of the playlists)
If I remember correctly the playlist you have highlighted (00020.mpls) is the correct US english version.
post #1705 of 3346
Quote:
Originally Posted by nickbuol View Post

I am out of town for the weekend, but when I expand them, they all show what seems to be the same 12 or whatever audio tracks, and the same large number of subtitles. The only thing that I saw different was the segments or whatever. Most were the same with just one or two different numbers in the sequence. I didn't look for a date/time unfortunately. And this isn't for every blu-ray. A lot of them are just one main choice with MakeMKV set to ignore anything less than 60 minutes in length.

At first I thought that maybe the movie(s) had a theatrical and extended edition on the same disc, or maybe a regular and an IMAX version for movies like Barman Begins, but nope....

http://lmgtfy.com/?q=makemkv+battle+los+angeles+which+segments


Here is a reasonable description of why none of the three choices will be any different http://www.makemkv.com/forum2/viewtopic.php?f=1&t=4648#p18889
post #1706 of 3346
Quote:
Originally Posted by Dark_Slayer View Post

http://lmgtfy.com/?q=makemkv+battle+los+angeles+which+segments


Here is a reasonable description of why none of the three choices will be any different http://www.makemkv.com/forum2/viewtopic.php?f=1&t=4648#p18889

Ha. Funny guy. (No, I really did chuckle after clicking the first link.) I did that, and it helped to figure out the Battle: LA example, but I ran into this more times than I would have cared for in the dozen rips I've done already. It sounds like the only solution is to manually play each segment to make sure that it is what you want, with no odd title changes for the different languages, and not jumping from one sequence to some random other sequence. The only alternative is to "hope and pray" that the one in the "most sequential order" is for English, but again, not always. I guess another step in the process for each of those discs.

I was hoping that some one had a slicker way to do it.

For those who click the second link, but it doesn't take them right to the post, it states:
"...the only difference is the localized title of the film.
So, for the title "World Invasion: Battle Los Angeles" it's 124,136,125
"Battle Los Angeles" is 124,125,126
"Invasion a la Tierra" is 124,137,126..."

I have been selecting whichever was listed "first" or "at the top" in MakeMKV. In this particular case, I guessed correctly.
post #1707 of 3346
Quote:
Originally Posted by Mfusick View Post

I hear you on that biggrin.gif I usually do my ripping every once in a while and more than 1 at a time. I'd rather do it faster, less frequently wink.gif Having more than one drive really cuts down on the time it takes and well worth the effort if you have more than just a few to rip, or if it's something you will be constantly doing ! I agree with you 100% on that.

There is no reason why it won't do exactly like you want it to do. I think you should be happy.

For me it just comes down to the specifics that probably do not matter for many other people. I started out thinking I was going to do it like you want to do it; but then I realized my personality and laziness was a factor I had not considered. I actually enjoy talking about media organization and I am always curios to find better ways to do it. I do it a certain way now that I can try to explain: (feedback on how crazy I am ???? tongue.gif )

When I first started HTPC I did not have much media and I was starting out with little. It was pretty easy to get up and running and going. As my media collection grew I kept gaining more and more "categories" which are folders on my FLEXRAID server pool. Inside each of those folders is those items or the parts of that collections. For example I have a folder called "Non HD movies" which I place all my movies into that are not 720p or better, mostly DVD's for example. I have another folder called "BLURAY RIPS" which only contain pure BR rips with HD audio and subtitles, and no compression at all. Minimum files size is usually about 20GB for these. I also have a HD movies folder that has stuff that might be transcoded or not pure BR MKV quality. This is various stuff that might still be 720p or 1080p but it's lower bit rate or smaller file size. Often I keep the stuff I really care about in full quality, but some stuff for whatever reason I don't want to devote the space for. I also have folders for "Disney" which is basically disney cartoons or anything that might be kid related, I also have a "XMAS" folder that has Season Christmas time favorites, My wife loves TITANIC and has some sick obsession with it so I have a collection that is all about the sinking and story of the TITANIC. I also have "ISO" folder that I keep full ISO's inside in case I want to play it back with the disc menu and special features- rather than just the movie MKV like I have in the movie folders. I also have a "TV SHOWS" folder that is loaded with different TV SHOWS or series. I could go on.. but I think you get the idea right ?

Years later (today) my collection is pretty big. I have two hard drives worth of TV and two more worth of Bluray, I have another full of DVD's, and another full of other stuff. I have probably 15TB of media, perhaps more. Now that my collection is getting large and complicated I find it harder to manage and keep up with it like I did when I was starting out. So I prefer to ONLY allow and keep 100% completed and finalized/organized folders inside my collections. Otherwise it's a mess on my front end clients and looks crappy. Wife would complain to me "you need a cover art folder for this" etc... and it really subtracted from the HTPC media browsing experience IMO, which is something I like about HTPC as compared to putting in a disc or surfing TV channels.

My decision to ONLY allow completed folders into my collections basically stems from my personality and tendency- I often might throw in a disc and rip it but I might not get back to organizing and naming it or doing the mediacentermaster thing on it until a few days later. I like not only ripping a few at a time, but also organizing a few a time. This cuts down on my time I need to spend on organizing my media. That is a thorn in my side, as I love the benefits of a highly organized media collection, but I really don't want to have to do the work or constantly maintain it. So by doing it the way I do I am able to spend less time and effort on it- and I never have "incomplete" media in my library either. I only add it when it's complete, and I don't care if it sits on my desktop for a day or two until I get it added. I simply do it as I am allowed time. In reality I am constantly doing a little bit of media organization all the time, but it never is hard or time consuming or feels like a chore or something I need to do, or that I have been neglecting.

For this reason I do not rip directly to my server pool anymore, or ever want to rip on my server directly. I would rather rip on my workstation desktop which has a nice gaming mouse, keyboard, mousepad, large triple monitors, and robust performance HDD and CPU. The entire process is easier in every regard and brings me much more enjoyment than doing it directly on the server. I could not imagine doing it without multiple screens, large screens, high level of control and high level of performance. I would go nuts. Just a personality thing- I appreciate things that are optimized or better than they simply need to be. It bring me pleasure enjoy something that is really great, as opposed to just acceptable. I'm nearly certain I can rip, name, organize and finalize media much faster than your average HTPC person- I probably do twice as much in half the time doing it my way. But again- my way is not for everyone.

I attribute this to the same thing as if you own two cars, one really nice one and one everyday beater normal car. You would get used to driving the really nice car and prefer that each time you had to drive almost negating ever wanting to use the less good car. Or if you have two TV or theater systems, one really good sound with huge picture, and one kinda small with not so good sound (good is relative) - which would you rather watch your movies on ?? The better one- and thus the crappier one would get used less, or for less critical viewing.

My desktop is a 4770k with fast SSD, RAM, and a very fast scratch disk (dual seagate 7200 in RAID 0 with SSD cache) I have three monitors, the smallest is 23" Samsung 1080p. My main display is 1200p 26" and I really want a 2560 30" soon. My mouse pad is a $60 Razer metal mouse pad with a Razer gaming mouse - I use the control surface with a very high DPI sensitivity. I actually have two keyboards, One Cherry MX switched, and another for gaming Macros. I've taken a lot of effort into my chair height, desk, monitor location- and little stuff to really maximize my experience on my PC. Not only do I enjoy PC in general, but also HTPC and also gaming. I realize I might have a set up that is a little different or more advantageous than everyone, and it's a big part of the reason why I would rather use my desktop than my HTPC, or my laptop, or my server. I guess I could use the BR drive in my laptop pretty easily and rip directly to the server- but the reality is laptops sucks in comparision to how I do it. Just moving the stupid touchpad frustrates me trying to check boxed in MakeMKV and the small screen kills my eyes when working with such details tongue.gif I am not saying there is anything wrong with using a laptop either- just it's not for me wink.gif

The last reason I do it the way I do it ( I know I am weird... bring on the flames ) is because the level of difficulty increases with the growing size of media. I find that the performance of MediaCenterMaster over LAN on a very large collection (think multiple TB's per folder and hundreds of folders or thousands of files ) is rather poor. There is a lot of extra waiting time while it tries to read the library, and it's a mega pain just waiting for it to load up and scan up and populate the screen with everything. Also- there is a lot of extra work in ripping directly to my server. For instance- I have to constantly change the scan folders in MediaCentermaster from one collection to another depending on what I want to work on. IE: Changing from BR rips to TV shows etc...

What I do locally on my desktop is I have a folder on my scratch disc called "-mediacentermaster" I put the " - " before it because it makes it show up as the first folder on the drive, and also as the first library location. That makes it really easy to drag and drop stuff to that folder:



My Mediacentermaster is always pointed at this directory. I never change that. I instead find it better to move stuff to this folder to work on it- then I copy it to my server and then delete it from my scratch disc. Sometimes I find I might get hundred of GB of stuff before I bother moving it- other times I might do something more urgent and move it over all in one shot. When I rip, once the rip is done I just move the file to the mediacentermaster folder by drag and drop. Because it's all on the same hard drive and shares the same root it just repopulates and moves there. There is no waiting or any "copy paste" function that needs to happen. It is instant. I hate waiting for files to copy and paste - that is BS.

The really cool thing I do with my server is I open up a RDP session (which works really well thanks to SSD in my server OS smile.gif ) and use mediacentermaster installed on my server in one window on one monitor while I can use mediacentermaster installed on my desktop on another monitor. This allows me to do both MOVIES and TV SHOWS at the same time- cutting down my time spent biggrin.gif Basically my desktop MCM program stays permanently fixed on the "-mediamaster" scan folder and works on that. The MCM on my server stays permanently set on the TV SHOWS FOLDER on my server. Each instance of the application is set for the right mode; IE. Desktop is set on movie mode with movie settings and the server MCM is set on "TV MODE" with TV optimized settings. I find that dealing with TV shows separate from movies makes life easier- and results better. And doing is this way saves me tons of time everywhere.

I used to copy directly to my server pool but I found that unless I was copying directly into the media collection that entire process still required a copy and paste function to relocate so I might as well enjoy the benefits inherent in my workstations performance. Copy from my desktop to the collection, or from my server to the collection really makes no difference to me. It's all the same result. And this way I don't have to constantly point my MCM to different collections or folders, or change settings from TV to movies, to MISC etc... It's really a lot easier for me this way. But I doubt my way would be easier or better for anyone else.

Very much of this was an evolving process, and very much of this has resulted from a growing collection. I used to do it the "normal" way when my media collection was smaller but now that it's bigger I find it best to only work on the "new" material and leave the old stuff that is already 100% alone.

You've possibly given me an idea on working with my collection using the two-monitor method. I had recently built an i7 3930K video editing workstation with a dual monitor setup so it would be a perfect way to work with all the HD material on one and different stuff on the other. I usually process all my new rips and get everything squared away before transferring it to the server, just to ensure that everything plays right and there are no issues.

An excellent post!
post #1708 of 3346
Quote:
Originally Posted by nickbuol View Post

How do I know that I am picking the right one in MakeMKV when it shows multiple long files sets?

@ Wilky13, I will check into that this weekend. There is a guy that I work with that was telling me that he uses .M2TS for all of his rips, but he seemed to just pick that without any real research he said, so I never looked further into it. I will see what the differences are and maybe run a conversion or two.

I do wonder if maybe it is my codecs. I have quite a few loaded on my computer, but nothing very recently updated. All a couple of years old.

I had never heard of m2ts either, but apparently Xbox's allow higher bit rates on m2ts than MKVs, which has fixed my stuttering and loading issues on the Xbox extenders.

For the HTPC itself I would suggest getting rid of all those "old" codecs and just install LAV or Shark007. I suggest checking out Assassin's HTPC Blog for step by step procedures for installing either. I actually wrote the Shark007 guide for him (Shark also did some edits to it), its a little outdated, but you will get the gist. Shark007 has done a lot of tweaking to make his codecs run well for LiveTV and Extenders, so I actually run his "Recommended Setup" now from his GUI. Works great for me (except multichannel AAC, but that is a totally different topic (you can get it to work if you use ffdshow instead of LAV) I digress).
post #1709 of 3346
Quote:
Originally Posted by itznfb View Post

Expand the playlist so we can see what is in them. Check the timestamps. Check the segments.

I've seen this on few movies. I just rip all 3, then play each, figure out which one I like and delete the other 2.
post #1710 of 3346
Quote:
Originally Posted by Wilky13 View Post

I've seen this on few movies. I just rip all 3, then play each, figure out which one I like and delete the other 2.
My copy of Lincoln has about 20, which makes this a tad impractical.
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Home Theater Computers
AVS › AVS Forum › Video Components › Home Theater Computers › Mfusick's How to build an affordable 30TB Flexraid media server: Information Requested.!