Using Piwik 0.2.22 auto archiving feature on a website with around 1400 visitors a day, (howto.landure.fr), the first use of archive.sh script is a memory black hole.
I do not use often the piwik web interface, so no auto archiving was done.
I've run at least 3 times archive.sh raising php memory limit at each time. It was finaly completed with a 768 MB memory limit !.
It is a big number for archiving.
Keywords: archiving memory cli
For more information, here is the messages i get:
Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 8208 bytes) in /var/www/piwik/core/DataTable.php on line 807
Fatal error: Allowed memory size of 268435456 bytes exhausted (tried to allocate 8208 bytes) in /var/www/piwik/core/DataTable.php on line 807
I've took a look at my table sizes
I've got 3 piwik_archive_blob archives tables with over 30000 records.
The memory problem seems to come from the year archiving. Piwik is probably loading all of month records blob without unloading them once they are not usefull anymore.
Hope this help locating the problem.
Keep the good work, and thank you for this wonderfull tool
Maciej (mauser) is working on the issue and should come up with a patch soon. please use this ticket to post patches etc.
Thank you, now it take less than 64MB to run the daily Piwik archiving.
Thank your for your great work :D.