Blank Banners (Error 500) Some Times

[iker]

First of all, I want to say thank you to all revive community that makes possible an open source project like this.

Well, some times once a week or two, some times 0 times in a week... we get ALL the banners blank and the error is (debugging with firebug) error 500 internal server error. Revive control panel works fine

Now, we use Revive 3.2.0 (blanks happened with 3.0.7 too) in a Cluster: 1 IP Load Balancer + 3 apache server (php 5.3.3 with XCache and apache 2.2.15) + 1 mysql server (mysql 5.6.25) + NAS and we are serving about 1.000.000.000 impressions per month. The CPU usage in all apache servers is about 40-50% at the high traffic hour. The problem happened using cache files and using memcached.

Well, for example, today the problem ocurred two times. First time, I didn't realize and was fixed when maintenance cronjob run. Second time, I see the blanks, I run the maintenance manually and banners showed fine.

This is mysql operations zabbix graph when the problem ocurred https://www.dropbox.com/s/i2h1ct525ffadb5/Captura%20de%20pantalla%202015-07-01%2003.20.18.png?dl=0

Maintenance cron run every hour: 1 * * * * and takes about 5-10 minutes to finish.

As you can see in the graph, banners begin to show blank in the minute 30... there isn't other cronjob running at that time.

Maybe in the minute 10, when maintenance finish plus 20 minutes more from cache refresh? I don't know because when the problem happens and I run the maintenance, all works fine again. Anyway, I need to fix this asap.

Any ideas? Thanks

[Erik Geurts]

If you see that the server is returning 500 Internal Server Error, the best approach is to look in the Apache error_log file on the server, since the exact details and cause of the error will be recorded in that file.

[iker]

There aren't any error related to error 500, I only see this [Wed Jul 01 11:12:23 2015] [error] [client 10.71.64.10] request failed: error reading the headers. The IP is private, I guess if from the load balancer.

And all error_log is full of similar lines, even when the banners are working fine.

 

Right now, happened again, run the maintenance and worked again... very very weird. But this time, ocurred after maintenance cronjob at 10:01 and didn't repair at 11:01 cronjob. I had to run manually again at 11:10 to fix it https://www.dropbox.com/s/xde4j0z7q0hlx16/Captura%20de%20pantalla%202015-07-01%2011.18.19.png?dl=0

[iker]

I enabled display erros in php and this is the error

 

Fatal error: Cannot redeclare max_checkgeo_country() in /public_html/plugins/deliveryLimitations/Geo/Country.delivery.php on line 28

[Matteo Beccati]

My suggestion: drop 5.3 and xcache and use something that's maintained, like 5.6 + opcache. Most of the times similar errors happen due to cache corruption.

[iker]

Fixed the error in the Country.delivery.php adding if (!function_exists('MAX_checkGeo_Country')) { and now a new error

 

Fatal error: Cannot redeclare max_checkclient_useragent() in /home/NFS-HA/vhosts/pubted.com/public_html/plugins/deliveryLimitations/Client/Useragent.delivery.php on line 28

 

Fixed, and new error

 

Fatal error: Cannot redeclare max_checkclient_browser() in /home/NFS-HA/vhosts/pubted.com/public_html/plugins/deliveryLimitations/Client/Browser.delivery.php on line 28

 

Fixed and now all banners are showing!!

 

Anyway, I think I will follow your suggestion Matteo