Results 1 to 5 of 5

Thread: How do i get only subfolders?

  1. #1
    Join Date
    Jun 2010
    Posts
    4

    Default How do i get only subfolders?

    The reason:

    I want all the *.g3x and the *.rfx from this one site:

    Site Name: http://www.knifeedge.com/forums/downloads.php?

    I haven't found a way to do this successfully, and I don't have enough knowledge
    of this software to know how to QUEUE URLS with
    http://www.knifeedge.com/forums/downloads.php

    since all the files and URL's to these files all that the above
    address...

    Example Starting URL:
    1. http://www.knifeedge.com/forums/downloads.php?
    2. http://www.knifeedge.com/forums/down...?do=cat&id=201
    3. http://www.knifeedge.com/forums/down...?do=cat&id=119
    4. http://www.knifeedge.com/forums/down...?do=cat&id=125
    5. http://www.knifeedge.com/forums/down...=file&id=13088
    6. http://www.knifeedge.com/forums/downloads/CALMATO 40 SPORTS ELECTRICT_EA.g3x

    The Problem is that the QUEUE goes to all the other URLs on the pages and
    they form endless loops so the QUEUE quickly fills to 200,000 and then it crashes...

    So is there a way to only add to the QUEUE URLS that start with?:
    http://www.knifeedge.com/forums/downloads

    If not, can you post how you would configure the properties for this job.

    Thanks
    Last edited by Swapfiles; 06-27-2010 at 12:05 AM.

  2. #2
    Join Date
    Jan 2008
    Location
    Melbourne, Australia
    Posts
    251

    Default

    When downloading a web site DownloadStudio has the option to only get files located in the folder and subfolder that the originating URL is located. This can be set in the "Span Across" setting on the download dialog.

    The ideal setting for this job is to traverse to a link depth of around 5. In the options dialog you can set up custom file type lists to download just the extensions you require (*.g3x;*.rfx).

    However it appears DownloadStudio is having some issues downloading and parsing the links for the site. Our developers are looking more closely at this at the moment. With some luck we may be able to fix the issue in time to make the DownloadStudio 6.0.4 release we are planning in the next week.
    Conceiva. Download it with DownloadStudio. Stream it with Mezzmo.

  3. #3
    Join Date
    Jun 2010
    Posts
    4

    Default Thank you for your prompt reply

    Because of the bandwidth used to locate these two files, the site has banned me because searching in an endless loop or the common links on each page over and over...

    The sad part is the files are less than 5 gig's and the site makes us download in endless loops to avoid bandwidth... but the endless loops and they ban Ip's makes us have to do it over an over, the end result is a waste of their bandwidth and our time. I appreciate your reply, and truly love your product as it works perfectly when used for it intended use. Thank you for considering my custom use in your future updates.

    Please reply to this thread, or message me when that update has been released, I would also like
    to get involved in beta testing if that is an option.

    Special Thanks.

  4. #4
    Join Date
    Jun 2010
    Posts
    4

    Default

    Now, the webmaster is Blocking my IP... is there a way that I can bypass their crap... these are public files
    they just don't want me to get the files without me clicking on each and every file... and they are
    very smalls files... they are just not very business smart, because I will tell people what a
    pain they are and not to buy there products because they limit the extra files... making a full install
    of their product a real pain.

    I have spent 477.00 for their products... and I will return all of it as I have enough
    of them implying what you get when you buy the products... but don't mention
    that they have no respect for their customers after they have received their funds...

    That is why I have tried to download their swap files before the shipment of their
    products arrive.... I am not happy with Knifeedge.com to say the least.

    -------------------------------- Edit ----------------------------

    Thank you everyone for the solutions, I really appreciate the
    Private Messages and Emails.

    The best tip for me was NOT to download immediately when your
    scanning for URL to the files, as this site blocked the scan if you
    are currently downloading.

    I love this product, and will promote it on my blogs and
    forums, Youtube etc..

    I consider this a tool for the disabled...
    and I feel is is a shame that this company has blocked the disabled...
    http://vimeo.com/13076231
    -----------------------------------------------------------------
    Last edited by Swapfiles; 07-16-2010 at 03:34 AM.

  5. #5
    Join Date
    Jan 2008
    Location
    Melbourne, Australia
    Posts
    251

    Default

    You may have been blocked by the knifeedge server due to the large number of connections a site job will try and make to a web site. Every web server have different policies on the number of concurrent connections from an IP address and also the number of requests that the site will allow from the one computer. Normally they will just block you for a short period.

    If you are still blocked from accessing the site, try using an anonymous proxy service, such as http://www.youhide.com/. This will allow you to still get to the web site in your web browser.

    Unfortunately we don't have an update for DownloadStudio yet. We are still hoping to be able to make some changes to enable you to download from this site in the upcoming version.

    I will keep you posted, and if we have a beta available before release I will let you know.
    Conceiva. Download it with DownloadStudio. Stream it with Mezzmo.

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •