Obsessive web caching?

Discussion in 'Computer Software and Operating Systems' started by Seriel, Jul 12, 2017.

  1. Seriel
    OP

    Seriel Worshipper of Skiddos

    Member
    2,703
    4,730
    Aug 18, 2015
    This is a weird one, but hey I use my computer a bit differently to other people so there we go.

    Basically, there will come times when I will not have internet access on my computer, sometimes its a long time, other times just a few hours. The thing that bugs me is when I try to quickly look something up on a page I just viewed recently (Or even the day before) but its already gone from the cache and I have to connect to view it again, which then halts my productivity due to not being able to view this one page. Kinda annoying.
    I do have a phone I could use for these situations, but I barely have credit or mobile data because of one reason or another, and when I do it goes pretty quickly lmao.

    My idea instead was something that caches every page you visit to disk, then when you are offline (Or in an optional offline mode) it will view the caches that it saved from before. Then when you visit the same page again online, the local cache will be overwritten. Disk space isnt a problem, I have tons spare and could use it being used for something actually constructive for once.

    I dunno if there's a software/browser/extension that does any of this stuff, but I'd really like to find something like this that I can use. Also in terms of OS, anything goes, just throw suggestions for Windows, Linux or MacOS and I'll evaluate how they fit into my uses of all three (I have them all installed lmao).

    I am aware Firefox has an "Offline Mode" which works similarly to what I need here, but its quite limited, only keeps the last couple pages, so its a bit useless most of the time.
     
    EthanAddict and TheVinAnator like this.
  2. EthanAddict

    EthanAddict Founder of Skiddon't-ism

    Member
    433
    1,929
    Nov 12, 2016
    Greece
    THAT, exactly that, but for most purposes, I use
    Code:
    info
    
    or
    Code:
    man
    
    because that is the content I might be searching...

    Apart from that, I don't us caching, but if I knew how, I would use it a lot(?)
     
  3. Seriel
    OP

    Seriel Worshipper of Skiddos

    Member
    2,703
    4,730
    Aug 18, 2015
    Yeah, man pages are a lifesaver on linux/unix/whatever, because they're downloaded locally.
    On arch I also download the package for offline arch wiki docs.

    But yeah, there are a lot of other things I need to view offline, and saving pages isnt cutting it anymore.
     
  4. EthanAddict

    EthanAddict Founder of Skiddon't-ism

    Member
    433
    1,929
    Nov 12, 2016
    Greece
    Link, package or whatever? I may need them Soon:tm:
     
  5. Seriel
    OP

    Seriel Worshipper of Skiddos

    Member
    2,703
    4,730
    Aug 18, 2015
    EthanAddict likes this.
  6. VinLark

    VinLark This machine kills bourgeois sentimentality.

    Member
    4,098
    4,799
    Jun 11, 2016
    Trinidad and Tobago
    4chan and other wonders of the internet
    Hmmmmm well I don't know if it can be used for this, but a general web catching thing that is really good is httrack. https://www.httrack.com/

    Works on Linux, Windows (and Mac maybe). If you know how to use a terminal you know how to use this. It just downloads pages and you can view them in html. It can also update catches. I use this for archiving web pages and putting them on my website, it works pretty good. I don't have something for your specific use though.
     
    mech and Seriel like this.
  7. Felek666

    Felek666 Demonically Uncontrollable

    Member
    3,410
    3,682
    Jan 3, 2017
    Poland
    reddit.com/r/satania/
    Chrome on Android allows you to download pages & save them then open it later.
     
    Seriel likes this.
  8. Joom

    Joom  ❤❤❤

    Member
    3,905
    2,624
    Jan 8, 2016
    United States
    You can use wget to save an entire site for offline use (logging in and making other things query SQL excluded).
     
  9. Seriel
    OP

    Seriel Worshipper of Skiddos

    Member
    2,703
    4,730
    Aug 18, 2015
    I am aware of that, my query was something that automatically saves pages as soon as I visit them, so I dont have to think "Oh I might need this later" and specifically download it
     
  10. EthanAddict

    EthanAddict Founder of Skiddon't-ism

    Member
    433
    1,929
    Nov 12, 2016
    Greece
    But, doesn't it eat disk space, or each website is very small, so it isn't noticeable?
     
  11. Seriel
    OP

    Seriel Worshipper of Skiddos

    Member
    2,703
    4,730
    Aug 18, 2015
    I already touched on that topic
     
  12. EthanAddict

    EthanAddict Founder of Skiddon't-ism

    Member
    433
    1,929
    Nov 12, 2016
    Greece
    Still, it is questionable, each site you visit? Or it is my concer, because I am a bit limited
     
  13. Seriel
    OP

    Seriel Worshipper of Skiddos

    Member
    2,703
    4,730
    Aug 18, 2015
    Websites dont use as much storage as one might think, and I have hundreds of gigabytes available.
    Not to mention I can always clear the cache when needed.-
     
  14. EthanAddict

    EthanAddict Founder of Skiddon't-ism

    Member
    433
    1,929
    Nov 12, 2016
    Greece
    Oh, this makes sense, and btw, my home partition is 95GB, so I am a bit concered about what I have there

    — Posts automatically merged - Please don't double post! —

    (even though I have a stash of random paintings I drew, screenshots and pictures I found on the Interwebz)
     
    Seriel likes this.