Solved Server lag after 5+ hours of uptime

Title, when I restart, the lag goes away and doesn't happen for another few hours. Not sure whats the problem.

My plugins:

BarAPI.jar
BattleKits.jar
BuyRegion.jar
Buycraft.jar
ChestCommands.jar
Clearlag.jar
CombatLog.jar
CommandSigns.jar
CustomJoinItems.jar
DisguiseCraft.jar
DoubleJumper.jar
DragRod.jar
DragonCast-Release.jar
EchoPet.jar
EnjinMinecraftPlugin.jar
Essentials.jar
EssentialsChat.jar
EssentialsGroupBridge.jar
EssentialsGroupManager.jar
EssentialsProtect.jar
EssentialsSpawn.jar
EssentialsXMPP.jar
Factions.jar
FrameProtect_v2.5.jar
GriefPrevention.jar
HealthBar.jar
HolographicDisplays-2.jar
KeepItems.jar
KitAddon-2.jar
KitsPreview.jar
LinksOnSigns.jar
Lockette.jar
LonelyServer.jar
MOTDColor.jar
MineResetLite.jar
MobArena.jar
MoneyDrop.jar
MultiEco.jar
Multiverse-Core-2.4.jar
Multiverse-Inventories-2.5.jar
Parkour.jar
PerWorldPlugins.jar
PlayerTrails.jar
PlotMe.jar
PlugMan.jar
PluginsBaker.jar
PressurePush.jar
PrisonRankup_v1.5.jar
Quake.jar
ShowCaseStandalone.jar
SpawnTP.jar
Spleef.jar
TNTRun.jar
TelePads.jar
Timeismoney.jar
TouchscreenHolograms.jar
Vault.jar
VoidGenerator.jar
Votifier.jar
VoxelSniper-5.168.9-SNAPSHOT.jar
WhatIsIt.jar
WorldEdit.jar
WorldGuard.jar
antiswear.jar
blinggrapplinghook.jar
coloredtablist.jar
floAuction.jar
iGates.jar
mcMMO.jar
uSkyBlock.jar
Any help is greatly appreciated

 

You need to look at the hard facts of performance over time. After about 5 minutes of the server being online and settled down, record the following:

Average CPU usage
Average RAM usage
Create a timings file to analyze plugin performance
Check /mem in-game and look at current TPS, Maximum/Allocated/Free memory
Check your server log for any errors.

Check each hour and record your findings.

You might have a memory leak or you might have a plugin that is freaking out. This will be easier to tell if you examine the timings file.

But looking at that list, I can see several heavy-hitters that will be at the top of your timings list on a normal basis simply for the fact of what they do: mcMMO, WorldGuard, GriefPrevention,Lockette, Multiverse, CombatLog (maybe showcasestandalone and plotme). Others that might spike your usage are your minigame plugins depending on usage.

You also didn't mention how many players are on your server or how much RAM you have allocated for it.

LHammonds

 

LHammonds This wasn't happening until a week ago. Before this happened, I had 30+ people with no problem at all. The server will have lag even if NOBODY is on. There are NO errors, and normally, CPU usage with even 20+ players is around 40-50% with a few spikes whenever something big happens. I have 5000 MB allocated. The only plugin I recently downloaded of the ones you suggested was CombatLog. I have had the others for months before with no problem. The lag happened before I instituted showcase standalone. Any thoughts?

 

Did the server go down hard or not shutdown improperly prior to the lag issues? Might be a corrupted world. Can check with MCEdit or rename the world folder and let it re-gen a new one to test temporarily. Could also install NoLagg and create a report when the server is lagging. Then double-click Nolag.jar to start the gui and load up the report to examine what is eating up the cycles on your server.

 

LHammonds The server doesn't go down, just every 5 seconds: Couldn't keep up! Did the system time change, or is the server overloaded? Skipping 23423 milliseconds. Its laggy as hell to play on, and stops/starts fine and has no lag after the restart. A bit confused on your MCEdit ideas/NoLagg. Could you go into more detail?

 

Plugin: NoLagg
More Details on Examine

In regards to improper shutdown, I was asking if that had happened before this mess started...such as a blackout, brownout, accidentally closing server window, etc. That can cause world corruption issues that can manifest in lag issues.

If you setup NoLagg and run an examine report, it can tell you more about the performance issues.

You don't have to keep it on your server, just to see what is going on from inside Minecraft.

LHammonds

 

LHammonds This never happened before I updated to 1.7.9

 

Have you done any timings reports? With the large number of plugins it is almost expected that at least one of them will misbehave when you do a version update.

 

lokpique What do you mean by timings reports?

 

Well, I'm sure not every plugin you have was compiled for 1.7.9 either...but yet you upgraded the server to 1.7.9 and now you have issues you have not had before. Makes one wonder if one of your plugins is not compatible with 1.7.9.

Ah, here is your problem. If you ever add plugins to your server, you MUST KNOW how to use timings or you are just trying to play darts with a blindfold on and hoping everything is working ok.

Do NOT leave timings enabled all the time. Only enable it when you need to profile your server.

The basic steps are:

1. Enable plugin-profiling in server.properties
2. Start your server and wait for a while to let the server collect some recording data
3. Collect the data: /timings merged
4. Disable plugin-profiling in server.properties
5. Find the timings file in your serverfolder/timings/timings*.txt
6. Copy the contents of the file and paste it in an online analyzer or just browse through it.

If you have a backup of your server prior to 1.7.9, you might want to get it running somewhere and create a timings report as a baseline for the plugin performance BEFORE the 1.7.9 update so you can more-easily tell which plugin(s) are acting out of the ordinary. It is kinda hard to tell without a good baseline from a well-functioning server to pin-point all bad-behavior. Sure, you can probably find the worst offenders fairly easy but sometimes there are problems that affect overall performance over time rather than a huge spike...and a bunch of small problems add up especially if you have a LOT of plugins like you do.

Further references:

• Troubleshooting lag
• How-To profile your server
• Bukkit Commands

LHammonds

 

That's what it sounds like to me. I'm getting "Could not pass event PlayerMoveEvent... NullPointerException" errors with 1.7.9 that I never got before.

 

I tested my server with 1.7.9 and got similar errors...which is why I'm staying at 1.7.5 and waiting for my plugins to catch up. Not all developers like to crank out updates for every dev version of craftbukkit. Some like to wait until there is at least a beta version available.

There are also potential issues with UUID and once you go to 1.7.9, there is no going back unless you restore to a version prior to 1.7.9 IIRC.

LHammonds

 

LHammonds Yeah...I guess I'll just hold tight for plugins to update Thanks for all your responses