BeeIMG System Maintenance Log 2014/12/20 [Completed]



Update 1:
Chose a really bad time for the upgrade!! Power cycle issued 1 hour ago, not done yet.


Update 2:
DO finally responded to my ticket. Proceeding with the upgrade as planned. Sorry for the unexpected and additional downtime.


Update 3:

* Started upgrading from Ubuntu 13.04
-2:08 PM GMT
* Completed - 2:32 PM GMT


Update 4:

* Started upgrading from Ubuntu 13.10
-2:35 PM GMT
* Completed - 2:45 PM GMT


Update 5:

* One more restart to update the kernel
-2:52 PM GMT
* Completed - 2:59 PM GMT


restarting normal service - 3:00 PM GMT



restarted normal service - 5:06 PM GMT





Additional log entries:









Note : This upgrade is marked as completed as of 2014/12/24

Comments

Post a Comment

Popular posts from this blog

Stability Improvements 2019

Hello all, Over the past few weeks BeeIMG has been a little unstable and just wanted to clarify on what happened. In the first unstable issue which in November were caused by our server provider doing maintenance on our servers. Our AMS node got hanged up during the maintenance and had to be manually restarted. However the impact on the service was minimal and the maintenance on our CDG node affected our service as its where our databases is hosted. After the maintenance the db server had been moved to under performing hypervisor and started to slow down the site. We had to move the server again to a better server. Forward to December, one on of our free customers started hitting with lot of image view per second and this overloaded memory on AMS server and to redis node to fail. Making maters worse AMS server ran out of disk space. when a fail over to CDG happened the traffic overload that servers redis node and caused the service to fail. The site served 503 errors durin...
Read more

Amsterdam Server and Forum

Hello all, Some of you may know that we had a 2 hour of downtime at the end of the last month. It had caused us to rethink the single server situation. As you some of you are expecting reliable uptime from BeeIMG.
Read more

Recent Hiccups May 2016

We faced some blackouts recently, and it was because we got very popular in china. The images that was generating lot of traffic were violating our TOS, but as they were generating lot of traffic and I thought it was a good time to stress test our image delivery systems. At first we were handling the load fine. after some time our redis server start acting wired. the issue was with dumping the db to disk, but as the images were generating lot of data the redis server crashed. we started to migrate the all gif images to be served by our CDN while still collecting views data. but at some point our real time stats handling script started to fail due to redis connection issues. after that the data started to collect and the redis server crashed every time it was started. While all that was happening we noticed that our php front end started throwing errors. this was due the connectivity issues to our redis server. The image serving end do not use redis server and was not afflicted. its usi...
Read more