or Connect
AVS › AVS Forum › Gaming & Content Streaming › ReplayTV & Showstopper PVRs › How can I only download new shows to DVA.
New Posts  All Forums:Forum Nav:

How can I only download new shows to DVA.

post #1 of 18
Thread Starter 
Hello,

First I will give my question in as few lines as possible for anyone who doesn't want to read all the details, then I will give most of the details in case someone can see a better way of solving my problem. If I miss a detail please feel free to ask and I'll do my best to answer.

Question:

Is there a way to use DVArchive to copy only shows off of a replay that it has not copied before?

Reason for the Question (aka Backstory):

I have three replays setup in my house, not a lot compared to some but enough for me, I try to leave most of the shows I record on them after I watch them in case someone requests them from poopli. However this ends up with me at times not remembering what all I have recorded which means I have to go thorough all the guides looking for shows, and sometimes I end up not watching something because a new episode gets recorded pushing one I haven't watched yet off the list.

I do have one copy of DVArchive currently running that I pull over shows I know I want to keep. Thanks Gary, now I can watch whatever episode of Futurama whenever I want.

I have recently increased the number of Hard Drives in my server so I now have more room to copy shows onto it. What I would like to do is copy over all the shows off one replay, preferably have them in the correct channels, and then just watch them off of the DVA instance. I would then delete the episode after I had watched it and know I was caught up. The problem is that then the next night I want DVA to copy over the files from the Replay that it hasn't already copied, but I don't want it to copy over the files I have deleted again.

Does this make sense? If not please let me know and I'll be happy to try to explain better.

The reason I don't want to just copy everything over to the DVA instances and then delete off of the Replays is it makes it easier for me to manage my space requirements, I don't particularly want to have to go through and check Hard Drive space and choose which shows to delete from which DVA instance.

The tools I have available to me are currently DVA, Wirns and IVSMagic. If there is another tool that would help with this I'd be happy to start learning it.

And if you have made it all the way down to here, one related question. If I am going to use DVA to copy my files over any advice as to what I should set the download speed to? I would hopefully have the download occurring during the night when I certainly wouldn't be watching any shows, and I believe there aren't many being recorded but I certainly can't guarantee that.

Thanks very much for reading this and any help you can offer will be much appreciated.

Also if you think you have a better way for me to do this please chime in and let me know, I'm happy to learn a new tool just sticking with these ones for now becuase I know how to use them although I will certainly admit there is a lot I've never done with them.

Eric
post #2 of 18
I think ClearToLand had posted a script that would do that. IIRC: "no_dups.bat" or something similar
post #3 of 18
Actually this isn't that easy really because I 'm not aware of any solution that allows DVA to "KNOW" that it downloaded a show already if that show has subsequently been deleted from DVA.

The DVArchive forum at DVArchive.org might have some suggestions.
post #4 of 18
I don't think it's possible....

I would like to do the exact same thing for a different reason.

Here's text from my post from a long time ago: http://archive2.avsforum.com/avs-vb/...ighlight=nhw3w
post #5 of 18
Quote:
Originally Posted by Kyndig View Post

Question:

Is there a way to use DVArchive to copy only shows off of a replay that it has not copied before?

Yes.

Quote:
Originally Posted by Kyndig View Post

...What I would like to do is copy over all the shows off one replay, preferably have them in the correct channels, and then just watch them off of the DVA instance. I would then delete the episode after I had watched it and know I was caught up. The problem is that then the next night I want DVA to copy over the files from the Replay that it hasn't already copied, but I don't want it to copy over the files I have deleted again.

Does this make sense?

Yes.

Quote:
Originally Posted by rm -rf *.* View Post

I think ClearToLand had posted a script that would do that. IIRC: "no_dups.bat" or something similar

True.

Only, instead of DELETING the show after you watch it from DVA, you'll need to 'Drag-N-Drop' it over the icon for 'Never_Download.Bat' (part of the No_Dups.Bat Script Set). This creates 0 byte .MPG, .NDX and .EVT files and puts them and the original .XML file into a new subdirectory LOCAL_GUIDE_DUPS.

Alternately, you can create a new category on your ReplayTV titled 'No Dups' and after watching the show, you could change it's category from 'TV Shows' to 'No Dups'. Then, overnight, a DVA Task Scheduler event will d/l the 4 files, execute the 'Never_Download.Bat' code and, optionally, DELETE the show from your ReplayTV.

For example, I keep 4 episodes of most weekly shows on my ReplayTVs, and I have a DVA Task Scheduler Event set to DOWNLOAD (not MOVE) any shows over 22 days old. So, if show #4 hasn't been watched in over 3 weeks, DVA Overflow(22) copies it to the DVA File Server before ReplayTV Scheduled Recording bumps it out into never-never-land on Day #28.

There are *MANY* messages in the Archives on this - look from around Dec 2005 and then forward ~6 months...

Quote:
Originally Posted by Kyndig View Post

...If I am going to use DVA to copy my files over any advice as to what I should set the download speed to? I would hopefully have the download occurring during the night when I certainly wouldn't be watching any shows, and I believe there aren't many being recorded but I certainly can't guarantee that.

  • 900-1200KBps if you know that the ReplayTV will be idle
  • 600-0900KBps if you will be using the remote, sparingly, for anything
  • 300-0600KBps if your ReplayTV is too sluggish for you when you use the remote
Also, for *ALL* speeds, always set the Max # to 1.
post #6 of 18
I've never seen a way to maintain the PC dvarchive image as an 'unlimited episode un-attended rolling backup' [as, when I'm away for a month or more], while leaving the actual latest two or three episodes on the replay itself [without incurring repeated downloads of the same files].
post #7 of 18
Quote:


Thanks Gary, now I can watch whatever episode of Futurama whenever I want.

Ok -- not picking on the poster here -- this post just triggered an OT question that has periodically flumoxed me:

Why do folks think my name is Gary?

I never spell my name Gary, my actual name is Gerry and it's pretty evident anywhere I put my name down at all. I've checked and other than posts here and on dvarchive.org, where folks have mistakenly called me Gary there are no instances where there is a Gary in the docs. DVArchive, help/FAQs, etc and yet I get at least one post or email a week related to DVA where the person warmly greets me as Gary.

To be clear, I'm not at all upset about being called Gary, but the intellectual side of me is just puzzled -- where does Gary come from and why is it such a common thing?

Any thoughts (not involving alein communists) would be appreciated :-)

GErry
post #8 of 18
Quote:
Originally Posted by Clay Schneider View Post

I've never seen a way to maintain the PC dvarchive image as an 'unlimited episode un-attended rolling backup' [as, when I'm away for a month or more], while leaving the actual latest two or three episodes on the replay itself [without incurring repeated downloads of the same files].

Quote:
Originally Posted by ClearToLand View Post

Overflow is a series of DVArchive Tasks (per show) on my DVArchive Server that give my ReplayTV(s) "virtually" Unlimited Capacity.

Well, you can't blame it on a lack of communication / effort from me :
  1. DVArchive Forum: [Alpha Testers] No_Dups.Bat Script Set - Posted: Sat Dec 17, 2005 00:33
  2. Poopli Forum: [Alpha Testers] No_Dups.Bat Script Set - Posted: 12-17-2005 01:09 AM
  3. Planet Replay Forum: [Alpha Testers] No_Dups.Bat Script Set - Posted: Sat Dec 17, 2005 1:46 am
  4. AVS Forum:[Alpha Testers] No_Dups.Bat Script Set - Posted: 12-17-05, 02:11 AM

If, IMHO, folks would have spent more time trying them out instead of being sarcastic and rude, the scripts might have benefited many...

Quote:
Originally Posted by rm -rf *.* View Post

Quote:
Originally Posted by ClearToLand View Post

Big DVArchive Fan, but no need for my No_Dups.Bat Script Set - May I ask why? Do you use the Task Scheduler?

When I originally read your posts on No_Dups.bat I viewed it as a DVArchive component or add-on. This might have been incorrect on my part.

You're scripts are good (abet underrated and underappreciated), and useful if someone uses task scheduling, theme channels and repeating recordings - none of which I happen to use...

Clay, you were here, actively posting during that time - how did you miss the announcement and/or the following discussions?
Read up on it in the various Archives and let me know - I'll be glad to help you get them running...
post #9 of 18
I didn't miss it -- I just don't see how it relates what I need.

Case in point, I want to keep a years worth of The Daily Show on the PC, downloading every day so the most recent show can be converted to another format for a portable player, but I want to keep the last five on the Replay itself. I'm not even all that concerned about avoiding a duplicate of a show repeated from a few months or weeks past -- I just want to get everyting to the PC, while keeping the last five on the Replay.

I can set the Replay to keep only the last five shows. Fine so far.
I can set Dvarchive to download every night in the wee hours. Fine so far.

However, to keep from downloading the last five shows every time, I have to set up duplicate checking [don't I? -- I'd be happy to be told that I don't really need duplicate checking in this situation and that maybe dvarchive checks the show ID to avoid repeat downloads without me turning on duplicate checking??? I guess I always assumed I needed some amount of duplicate checking turned on to avoid duplicate downloads.]

Anyway, with this show [and some others I record], duplicate checking doesn't work reliably. The show title is always the same, the show episiode is always empty, and many times, a whole week of the description is empty as well. So if I turn on any one of the duplicate criteria, I many times don't get the latest show downloaded at all, even though it is not a duplicate.

Hence, some months ago, I asked Gerry if he could add a new age selection criteria to consider only shows NEWER than X days as a companion to his current OLDER than X days -- something that would seem to do just what I want with little overhead. I would run a copy every day, while only looking for shows newer than 1 day. Job done. A continuous running backup.

[Yes, as an alternative I suppose I could download every day and delete, then move shows older than a week into a hidden dvarchive folder so I would still only see the most recent week's shows from the Replay rather than some huge list, but I have some slow drives on an old PC as my archive and I don't particularly like streaming off it -- just using it as a real 'archive'.]
post #10 of 18
Quote:
Originally Posted by Clay Schneider View Post

I didn't miss it -- I just don't see how it relates what I need.

I guess I was right, huh?
post #11 of 18
Quote:
Originally Posted by Clay Schneider View Post

I guess I was right, huh?

[Here we go, once again, with the same old AVS crap.]

NO! You were wrong.

DVArchive, with or without the No_Dups.Bat Script Set, will: ...maintain the PC dvarchive image as an 'unlimited episode un-attended rolling backup' [as, when I'm away for a month or more], while leaving the actual latest two or three episodes on the replay itself [without incurring repeated downloads of the same files].

Thus, your statement: I've never seen a way to... was questioned and a solution proposed.

Re-read what you INITIALLY posted; re-read my reply.
Quote:
Originally Posted by Clay Schneider View Post

I've never seen a way to maintain the PC dvarchive image as an 'unlimited episode un-attended rolling backup' [as, when I'm away for a month or more], while leaving the actual latest two or three episodes on the replay itself [without incurring repeated downloads of the same files].

Quote:
Originally Posted by ClearToLand View Post

Overflow is a series of DVArchive Tasks (per show) on my DVArchive Server that give my ReplayTV(s) "virtually" Unlimited Capacity.

DVArchive, all by itself, as-delivered, yada, yada, yada, will do *EXACTLY* what you INITIALLY asked for: an 'unlimited episode un-attended rolling backup' . Have you ever read the documentation? Since Gerry popped in here, flumoxed, to comment about 'Gary', I thought that he might reply to that point, which is why I initially didn't.

[DVArchive, by itself, has SO MUCH functionality already built-into it that, IMHO, the majority of it's users aren't even aware of. For example, SEARCH any of the ReplayTV Forums for discussions on:
  • Custom Web Templates
  • Task Scheduler
  • Post Download Processing
and see how many threads you find. ]

Now, if you want to:
  • VIEW one of those archived shows on the DVA PC
  • DELETE the show after viewing to free up space
  • NEVER DOWNLOAD that show from the ReplayTV to the DVA PC again
the addition of No_Dups.Bat will accomplish that. [You can also look into WiRNS with JIT and ReplaySchedule for other possible solutions to your situation.]

Quote:
Originally Posted by Clay Schneider View Post

I didn't miss it -- I just don't see how it relates what I need...

Ah. Now you're changing the requirements.

Quote:
Originally Posted by Clay Schneider View Post

...However, to keep from downloading the last five shows every time, I have to set up duplicate checking [don't I? -- I'd be happy to be told that I don't really need duplicate checking in this situation and that maybe dvarchive checks the show ID to avoid repeat downloads without me turning on duplicate checking??? I guess I always assumed I needed some amount of duplicate checking turned on to avoid duplicate downloads.]

Let's see - DVA Duplicate Show Handling states:
Quote:
Originally Posted by DVArchive Copy Show Action View Post


Consider a show duplicate if...
  • Show Titles Match
  • Episode Titles Match
  • Episode Descriptions Match

Quote:
Originally Posted by Clay Schneider View Post

...Anyway, with this show [and some others I record], duplicate checking doesn't work reliably.
  • The show title is always the same,
  • the show episiode is always empty,
  • and many times, a whole week of the description is empty as well.
So if I turn on any one of the duplicate criteria, I many times don't get the latest show downloaded at all, even though it is not a duplicate.

Have you discussed this with Gerry over on the DVArchive Forums?

I don't see how you can make the statement that: ...duplicate checking doesn't work reliably, given the fact that the show in question supplies NONE of the documented, required DVA Duplicate Show Handling Parameters.

Quote:
Originally Posted by Clay Schneider View Post

...Hence, some months ago, I asked Gerry if he could add a new age selection criteria to consider only shows NEWER than X days as a companion to his current OLDER than X days -- something that would seem to do just what I want with little overhead. I would run a copy every day, while only looking for shows newer than 1 day. Job done. A continuous running backup.

Sounds good - what was Gerry's reply?

Quote:
Originally Posted by Clay Schneider View Post

[Yes, as an alternative I suppose I could download every day and delete, then move shows older than a week into a hidden dvarchive folder so I would still only see the most recent week's shows from the Replay rather than some huge list, but I have some slow drives on an old PC as my archive and I don't particularly like streaming off it -- just using it as a real 'archive'.]

That would work too.

If someone wants to record and save all the available (i.e. currently showing, over-and-over) episodes of a 'Regularly-Repeating' show (i.e. Battlestar Galactica, Monk, Mythbusters, CSI: Miami on A&E, The Sopranos on A&E, Six Feet Under on Bravo, etc...), DVArchive will handle it.

If, in addition, they want the ability to delete the episodes they've already watched, while at the same time not download them again, No_Dups.Bat will handle that.

Apples and Oranges, Clay.

And, I'm just 'clarifying' it for any Newbies who might come across this thread...

P.S. *IF* you (or anyone else reading this thread) have a show with *SOME* distinguishing parameters (Show Title, Episode Title, Episode Description), I'd be more than happy to help you set up DVArchive (and No_Dups.Bat, if necessary). In the meantime, back to something more 'interesting'...
post #12 of 18
Quote:
Originally Posted by gduprey View Post


Why do folks think my name is Gary? ... Any thoughts (not involving alein communists) would be appreciated :-)

My only theory is that people are confusing you with l8er whose name is indeed GARY.
post #13 of 18
Quote:
Originally Posted by ClearToLand View Post

off point items removed

[woops, nothing left]

Though I must thank you for reposting my original issue, which as you have noted, for this particular show [and others, like 'The Colbert Report' just to make it clear this is not an isolated issue], is in fact, not possible -- with our without your routines.

[Wow, and I didn't even need 27 flavors of color and font to say that either (just for the benefit of the Newbies).]
post #14 of 18
Quote:
Originally Posted by gweempose View Post

My only theory is that people are confusing you with l8er whose name is indeed GARY.

I doubt that's it.

(wink)

More likely it's because they are using smallish fonts. Or they perhaps were when they first got to know Gerry. Or they need a new prescription.

You can demonstrate the effect:

Gerry may leave the impression of Gary because the r's merge and the e looks like an a, depending on font. And if you squint.

Kind of optical illusion.

The illusion may be more believable since some may be more accustomed to J as in Jerry.
post #15 of 18
Quote:
Originally Posted by gduprey View Post

Ok -- not picking on the poster here -- this post just triggered an OT question that has periodically flumoxed me:

Why do folks think my name is Gary?

I never spell my name Gary, my actual name is Gerry and it's pretty evident anywhere I put my name down at all. I've checked and other than posts here and on dvarchive.org, where folks have mistakenly called me Gary there are no instances where there is a Gary in the docs. DVArchive, help/FAQs, etc and yet I get at least one post or email a week related to DVA where the person warmly greets me as Gary.

To be clear, I'm not at all upset about being called Gary, but the intellectual side of me is just puzzled -- where does Gary come from and why is it such a common thing?

Any thoughts (not involving alein communists) would be appreciated :-)

GErry

I'd say it's your parents fault. I love DVArchive - thank goodness you finally put a paypal button on the www.dvarchive.org website! I think you could be the poster child for providing a great example of how to set and keep boundaries. The whole Gerry/Gary problem comes down to having a "strange" name, which you didn't choose. The whole thing is just too French sounding in the post 911 world. We like you and your work too much to believe you have a frenchy name.

Learn more about how naming a child matters at http://www.freakonomics.com/ch6.php
post #16 of 18
Well, I like Gerry being as it's a little less than common. Since my proper name is Gerald, it isn't some random affectation to use a G instead of J. And given my family background is 3/8ths french (and 1/4 polish, 1/4 english and 1/8 native american), so Frenchy it be :-)

I will say, in my life, I have only met 2 other Gerry's with a G (not counting my father -- the senior to my junior) and that has sort of surprised me. Met plenty of Jerry's though (pretenders!)

Gerry
post #17 of 18
Quote:
Originally Posted by gduprey View Post

Why do folks think my name is Gary?

I suspect that it is a common brain twist with a quick glance at the spelling bringing up the first name that comes to mind. I LOVE some of the posts on sentences that your brain can figure out even though so many letters are missing!

I infrequently get called Harry instead of Henry, and I don't think those are very close, either, but it is really very infrequently...

By the way, I have several friends name Gerry for Gerald, so it may be that I am accustomed to seeing it spelled that way and have no problem recognizing it...

Henry
post #18 of 18
Clay, as I mentioned above in my post from October '06, what we are trying to do cannot be done the way DVA works now.

My workaround is to dedicate one of my RTVs to just save one episode every day of the particular show. In my case , like yous, I'm downloading The Colbert Report (The Daily Show too). The shows are downloaded to the PC from DVA...a perl script runs and convert/writes an .avi file to an SD card in card reader hooked up to the PC running DVA. The SD card goes into my Palm TX for my daily train ride.

I keep a running 2 weeks worth of Daily and Colbert on another RTV. I pity those who have only 1 RTV and are trying to do this...
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: ReplayTV & Showstopper PVRs
AVS › AVS Forum › Gaming & Content Streaming › ReplayTV & Showstopper PVRs › How can I only download new shows to DVA.