DataTools

44 - Cache data to a file

Just a suggestion since my datamines are taking upwards of a half hour and I'm finding minor issues with it near the end.

Anything mined from the web-site is cached in a file.

If the file exists and is older than an hour, it will get the data again, if it exists and is younger than an hour, it will use the cached data.

Not sure how hard this would be to implement... and I would personally have no idea how to do this.

User When Change
Ackis Nov 19, 2008 at 21:11 UTC Create

You must login to post a comment. Don't have an account? Register to get one!

  • 2 comments
  • Avatar of kagaro kagaro Nov 20, 2008 at 13:47 UTC - 0 likes

    I really dont wana cache every web page it grabs as bugs are found and fixed.

  • Avatar of kagaro kagaro Nov 20, 2008 at 13:47 UTC - 0 likes

    ill ad caching in, once all the kinks are worked out.

  • 2 comments

Facts

Reported
Nov 19, 2008
Status
Accepted - Problem reproduced / Need acknowledged.
Type
Enhancement - A change which is intended to better the project in some way
Priority
Medium - Normal priority.
Votes
0

Reported by

Possible assignees