Stability Improvements 2019

Hello all,

Over the past few weeks BeeIMG has been a little unstable and just wanted to clarify on what happened.

In the first unstable issue which in November were caused by our server provider doing maintenance on our servers. Our AMS node got hanged up during the maintenance and had to be manually restarted. However the impact on the service was minimal and the maintenance on our CDG node affected our service as its where our databases is hosted. After the maintenance the db server had been moved to under performing hypervisor and started to slow down the site. We had to move the server again to a better server.

Forward to December, one on of our free customers started hitting with lot of image view per second and this overloaded memory on AMS server and to redis node to fail. Making maters worse AMS server ran out of disk space. when a fail over to CDG happened the traffic overload that servers redis node and caused the service to fail. The site served 503 errors during the time.

To fix this issues, a new server was added in CDG bring our server count to 3. This server will host the database and the database successfully migrated to the new server. It will also server as a storage node to free some space on CDG1.

Then we noticed that redis node getting unresponsive. when checked, the huge image request backlog created by the earlier issue made redis slow and unresponsive from time to time. We tweaked the scripts to process more requests to process the backlog.

We also moved our CDG1 server to a new one, migrating from Ubuntu to Debian.

To provide better service to every one in the future a image view limit will be added for free members

Due this instability all premium members will get 2 months added to their plan.

Thanks for reading.

Comments

Anonymous said…
tejaratonline.irPerhaps the most important point in buying a mobile phone is to check the availability of phone parts. Because, for example, if the touch LCD of your phone breaks down
September 22, 2021 at 3:09 AM
frzn said…
Ways to have a comfortable delivery are all the steps you can take before pregnancy, during pregnancy and after delivery to experience a better and easier pregnancy and delivery. These steps start with choosing a good pregnancy https://danestanyonline.ir/%d8%aa%d9%85%d8%b1%db%8c%d9%86-%d8%b1%d9%88%d8%b4%e2%80%8c%d9%87%d8%a7%db%8c-%d8%a2%d9%85%d8%a7%d8%af%da%af%db%8c-%d8%b2%d8%a7%db%8c%d9%85%d8%a7%d9%86-%d8%a8%d8%b1%d8%a7%db%8c-%d8%af%d8%a7%d8%b4%d8%aa/ doctor and continue to perform various exercise techniques to ensure the health of the pregnancy. Proper nutrition, good mood, avoidance of stress, exercise, yoga, walking, reading books and many other activities will help you to experience a better and easier delivery.
November 15, 2021 at 4:20 AM
Satara Escorts said…
Great Post Written by You. Thanks for Sharing
July 29, 2023 at 10:35 PM
Schloka Escorts Shimla said…
Such A Great Post and Informative For Me, Thanks for Sharing Like This Posts
August 17, 2023 at 2:08 AM
body to body massage in bangalore said…
A destination spa is a spa facility located in a scenic or remote location. It focuses on holistic wellness and offers an immersive experience with activities such as fitness classes, nutrition counseling, meditation, and outdoor adventures.
February 23, 2024 at 2:03 AM
nuru massage in bangalore said…
b2b spa sessions can boost morale, reduce absenteeism, and increase productivity by alleviating stress and promoting a positive work environment.
March 25, 2024 at 10:53 PM
female to male body massage near me said…
female to male massage near me targets the deeper layers of muscles and connective tissues, we are sure if you once take our spa services then you feel relax
March 27, 2024 at 10:51 PM
body massage at home in hyderabad said…
If you're looking for a massage at home service in Hyderabad, IZ spa gives you several options available.
April 30, 2024 at 12:08 AM
body to body massage said…
The massage typically takes place in a quiet, dimly lit room with soothing music playing in the background table is covered with soft linens
May 11, 2024 at 3:00 AM
MassageInc said…
A full body massage in bangalore will give you the ultimate pampering experience, as the spa staff here massages all parts of your body through deep pressure. You can choose your desired female or male spa staff and engage in your services and get the essential spa services as well as the extra spa services.
September 5, 2024 at 11:25 PM
Tyson H said…
Thhanks for a great read
October 15, 2024 at 2:01 PM
Post a Comment

Popular posts from this blog

Amsterdam Server and Forum

Hello all, Some of you may know that we had a 2 hour of downtime at the end of the last month. It had caused us to rethink the single server situation. As you some of you are expecting reliable uptime from BeeIMG.
Read more

Recent Hiccups May 2016

We faced some blackouts recently, and it was because we got very popular in china. The images that was generating lot of traffic were violating our TOS, but as they were generating lot of traffic and I thought it was a good time to stress test our image delivery systems. At first we were handling the load fine. after some time our redis server start acting wired. the issue was with dumping the db to disk, but as the images were generating lot of data the redis server crashed. we started to migrate the all gif images to be served by our CDN while still collecting views data. but at some point our real time stats handling script started to fail due to redis connection issues. after that the data started to collect and the redis server crashed every time it was started. While all that was happening we noticed that our php front end started throwing errors. this was due the connectivity issues to our redis server. The image serving end do not use redis server and was not afflicted. its usi...
Read more