I have a small project which crawls data from the internet consistently. After every achievement of a single HTTP request, I save the data to a local file immediately. That causes a problem that the program white too frequently, it's low in performance.
So, is there a mature solution that will maintain the integrity of business and also avoid frequent file writing?
Aucun commentaire:
Enregistrer un commentaire