Maintenance Not Running - Error In Debug.log

[JaySchoolzine]

Hi guys,

 

I'm running Revive 3.0.2.

 

We're having an issue we need resolved urgently. Our stats haven't been updating, though maintenance appears to be running.

 

The data appears to all be in 'rv_data_bkt_m' table, but isn't getting processed/moved. Looking in our debug.log, we're getting an error and I can't seem to find out how to fix it. Here's the log info:

Sep 29 14:07:06 +1100 OX-5428ccda99317 [     info]  Running Automatic Maintenance Task
Sep 29 14:07:06 +1100 OX-5428ccdab48b7 [     info]  Automatic Maintenance Task not run: could not acquire lock
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [     info]  Running Maintenance Engine
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [     info]  Running Maintenance Statistics Engine
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [     info]  Task begin: OX_Maintenance_Statistics_Task_SetUpdateRequirements
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [     info]  - Maintenance statistics will be run
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [     info]  - The intermediate table statistics will be updated
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [     info]  - The final table statistics will be updated
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [     info]  Task complete: OX_Maintenance_Statistics_Task_SetUpdateRequirements
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [     info]  Task begin: OX_Maintenance_Statistics_Task_MigrateBucketData
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [     info]      - The rv_data_bkt_a table is a raw data table. Data logged in real-time, not operation intervals.
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [     info]      - Accordingly, pruning of the rv_data_bkt_a table will be performed based on data that has a logged date between 
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [     info]        2014-09-29 02:00:00 UTC and 2014-09-29 02:59:59 UTC
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [     info]      - The rv_data_bkt_a_var table is a raw data table. Data logged in real-time, not operation intervals.
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [     info]      - Accordingly, pruning of the rv_data_bkt_a_var table will be performed based on data that has a logged date between 
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [     info]        2014-09-29 02:00:00 UTC and 2014-09-29 02:59:59 UTC
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [    error]     ERROR: Could not migrate aggregate bucket data from the 'rv_data_bkt_c', 'rv_data_bkt_m', 'rv_data_bkt_r' bucket table(s)
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [    error]     Error message was: MDB2 Error: constraint violation
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [     info]  Task complete: OX_Maintenance_Statistics_Task_MigrateBucketData
Sep 29 14:07:06 +1100 OX-maintenance-5428ccda99317 [     info]  Task begin: OX_Maintenance_Statistics_Task_DeDuplicateConversions
Sep 29 14:07:07 +1100 OX-maintenance-5428ccda99317 [     info]  Task complete: OX_Maintenance_Statistics_Task_DeDuplicateConversions
Sep 29 14:07:07 +1100 OX-maintenance-5428ccda99317 [     info]  Task begin: OX_Maintenance_Statistics_Task_ManageConversions
Sep 29 14:07:07 +1100 OX-maintenance-5428ccda99317 [     info]  Task complete: OX_Maintenance_Statistics_Task_ManageConversions
Sep 29 14:07:07 +1100 OX-maintenance-5428ccda99317 [     info]  Task begin: OX_Maintenance_Statistics_Task_SummariseFinal
Sep 29 14:07:07 +1100 OX-maintenance-5428ccda99317 [     info]  Task complete: OX_Maintenance_Statistics_Task_SummariseFinal
Sep 29 14:07:07 +1100 OX-maintenance-5428ccda99317 [     info]  Task begin: OX_Maintenance_Statistics_Task_LogCompletion
Sep 29 14:07:07 +1100 OX-maintenance-5428ccda99317 [     info]  Task complete: OX_Maintenance_Statistics_Task_LogCompletion
Sep 29 14:07:07 +1100 OX-maintenance-5428ccda99317 [     info]  Task begin: OX_Maintenance_Statistics_Task_ManageCampaigns
Sep 29 14:07:07 +1100 OX-maintenance-5428ccda99317 [     info]  - Managing (activating/deactivating) campaigns
Sep 29 14:08:03 +1100 OX-maintenance-5428ccda99317 [     info]  Task complete: OX_Maintenance_Statistics_Task_ManageCampaigns
Sep 29 14:08:03 +1100 OX-maintenance-5428ccda99317 [     info]  Maintenance Statistics Engine Completed (Started at 2014-09-29 03:07:06 UTC)
Sep 29 14:08:03 +1100 OX-maintenance-5428ccda99317 [     info]  Running Maintenance Priority Engine
Sep 29 14:08:03 +1100 OX-maintenance-5428ccda99317 [     info]  Task begin: OA_Maintenance_Priority_AdServer_Task_GetRequiredAdImpressionsLifetime
Sep 29 14:08:03 +1100 OX-maintenance-5428ccda99317 [     info]  Task complete: OA_Maintenance_Priority_AdServer_Task_GetRequiredAdImpressionsLifetime
Sep 29 14:08:03 +1100 OX-maintenance-5428ccda99317 [     info]  Task begin: OA_Maintenance_Priority_AdServer_Task_GetRequiredAdImpressionsDaily
Sep 29 14:08:03 +1100 OX-maintenance-5428ccda99317 [     info]  Task complete: OA_Maintenance_Priority_AdServer_Task_GetRequiredAdImpressionsDaily
Sep 29 14:08:03 +1100 OX-maintenance-5428ccda99317 [     info]  Task begin: OA_Maintenance_Priority_AdServer_Task_AllocateZoneImpressions
Sep 29 14:08:03 +1100 OX-maintenance-5428ccda99317 [     info]    - Selecting Zones forecasts for all managers for OI from 2014-09-29 03:00:00 to 2014-09-29 03:59:59

As you can see we're getting a "constraint violation" error. We're also getting "Automatic Maintenance Task not run: could not acquire lock" and I'm not sure if that's related too. I can't figure out why this is happening. I've tried all solutions I could find on the internet and these forums, but nothing worked for me.

 

If anyone has any ideas on how to solve this, it would be greatly appreciated.

 

 

Thanks in advance,

Jay.

[Erik Geurts]

Please upgrade to the most recent version of Revive Adserver first.

 

You can find the download link here: http://www.revive-adserver.com/download/

Instructions for upgrading here: http://www.revive-adserver.com/support/upgrading/

[JaySchoolzine]

Hi Erik,

 

Thanks for the prompt reply.

 

This issue started when we filled up our hard drive without realising and we had some corrupting issues. We solved those issues with a table repair, but since then, we've had this problem. I don't believe it to be an issue with 3.0.2 and I'd rather not upgrade if we can avoid it, as a precautionary measure. I'd rather just solve it with our current version if possible.

 

Do you know what the problem might be based on that specific error message?

 

 

Thanks,

Jay.

[JaySchoolzine]

An update on this:

 

I ran another repair on the whole DB and managed to get the error to stop. It seems to be working now, BUT the old stats are still in the bkt tables and aren't getting processed.

 

When the maintenance runs, it only seems to process the stats since the last time it ran (today). We need it to run through the previous month build up of stats too. Is there a way to get it to do this? Or should it already be doing this now?

 

Additionally, I tried running the maintenance script manually, but it seemed to do the same thing (only do recent stats OR it's timing out). It does seem this amount of rows (1208424) would be too many to process before reaching the max_execution_time? Is this a concern for Revive's maintenance process? Or will it make no difference?

 

Your help is appreciated.

 

 

Thanks,

Jay.

[danharper]

I have the same problem, how did you repair the tables?

[JaySchoolzine]

Hi Dan,

 

I initially ran it through phpMyAdmin on the corrupt tables, but then the second time I ran it through MySQL Databases in cPanel on the whole database, rather than specific tables.

 

Try running a Check on the database first and see if it reports any corruption (mine did). That'll be a good indication.

 

Good luck!

 

I'm still trying to work out how to process the bkt data for the past month though if anyone has any ideas.

 

 

Thanks,

Jay.

[JaySchoolzine]

Another update:

 

I found the /scripts/maintenance/tools/migrateBucketData.php file which on the face of it looks like exactly what I need.

 

However, when I run it using these date/times:

define('INTERVAL_START', '2014-08-01 00:00:00');
define('INTERVAL_END',   '2014-09-22 23:59:59');

It seems to run successfully (no errors) and completes, but nothing changes in the database. All the records are still in the data_bkt_m table. I also tried running the other maintenance tool file (statisticsTestAndCorrect.php) but had a similar problem.

 

It said "correcting" for one record but then said it finished and things looked the same.

 

Am I using these files wrong? Is there a file that will do what I want it to?

 

Help would be really appreciated.

 

 

Thanks,

Jay.

[JaySchoolzine]

A final update - I fixed it:

 

I tried another tool in that folder called "republish.php" using the following SSH command:

php /home/********/public_html/scripts/maintenance/tools/republish.php www.******.com '2014-08-01 04:00:00' '2014-10-01 23:59:59'

And it did exactly what I needed! Processed the 1mil+ records in a few minutes and all stats are reporting as usual.

 

A bit disappointed I had to dig around for so long to find this solution, rather than having some info/documentation about these tools or giving helpful responses on the forums, but I hope this solution helps someone else in the future.

[Andrej Zeleznik]

Jay, thank you for that. 

After few hours, i found you post and everything is working now.

 

Thanks,

Andrej

[firstimpression]

Jay, thank you so much, saved me a lot of painful hours