44 - Cache data to a file
Just a suggestion since my datamines are taking upwards of a half hour and I'm finding minor issues with it near the end.
Anything mined from the web-site is cached in a file.
If the file exists and is older than an hour, it will get the data again, if it exists and is younger than an hour, it will use the cached data.
Not sure how hard this would be to implement... and I would personally have no idea how to do this.
| User | When | Change |
|---|---|---|
| Ackis | Nov 19, 2008 at 21:11 UTC | Create |
- 2 comments
- 2 comments
- Reply
- #2
kagaro Nov 20, 2008 at 13:47 UTC - 0 likesI really dont wana cache every web page it grabs as bugs are found and fixed.
- Reply
- #1
kagaro Nov 20, 2008 at 13:47 UTC - 0 likesill ad caching in, once all the kinks are worked out.