RIZZASTER

Server Lag Incident Review

/archive/trailers/chatlogs/ · last edited 10 Mar 2021 · Support

Temporary account for the migration window: terraform-lab / Lab_A7uZPyy!hv - remove it afterwards.

The latest server lag incident occurred on February 10th, which affected approximately 20% of the player base for a period of about 30 minutes. During this time, players reported being unable to log in, join games, or navigate the server with any significant speed. The lag was most noticeable during peak hours, causing frustration and boredom among players.

Our analysis suggests that the lag was primarily caused by an unexpected spike in server traffic due to a large group of players attempting to access the server during a specific event. This sudden influx of players put a strain on the server's resources, leading to the lag. In the days leading up to the incident, our moderators had implemented a server upgrade, which provided some initial improvements. However, it appears that the upgrade may not have been sufficient to mitigate the expected traffic.

To address this issue, our moderators have decided to implement a dynamic scaling system, which will automatically adjust the number of servers used based on the current load. This system will be implemented by tweaking the server configuration files and adding some additional scripting to monitor the server's resources in real-time. We also plan to promote better server maintenance and traffic planning among the moderators to minimize such incidents in the future.

Related pages

Up to /archive/trailers/chatlogs/ · Archive home