Massive lag issues - need professional help! (High end user)

Hello there!

So, for about a week now my main server has been experiencing some weird lag. Its not after a craftbukkit update and it doesnt seem to be continued by a plugin.
The lag ticks once every 500ms everything is ticking forward at the same speed.
Also picking up blocks take ages sometimes up to 15sec.
Placing blocks also has some small issues.

I have run Chunkster twice, I have used the Vegetation plugin but set it to that animals can eat the grass really fast to see if the lag might be caused by too much wildgrass. This worked once 2 weeks ago. Didnt work this time.

The map has a border of 2500blocks and 8GB of ram dedicated.

Plugins: NSCommand, NoCheat, iChat, Tuto, MinecartManiaCore, dynmap, LightVote, AutoSave, Repair, AntiXRay, WorldEdit, Cleaner, LastLogin, WorldGuard, BorderGuard, Lockette, Vanish, PermissionsPlus, PlgColdLightning, FoundDiamonds, Essentials, BlocksOnGlass, iConomy, MinecartManiaAutocart, MinecartManiaTeleport, MinecartManiaSignCommands, EssentialsSpawn, ThunderJoin, AutoMessage, Vegetation, Backup, BigBrother, MinecartManiaStation, VehicleZap, MinecartManiaChestControl, Permissions, iConomyChestShop

Vegetation set to removing grass not spawning anything.


Id love to have a discussion going about the lag so please go ahead. I dont want stupid answers like "have you tried to restart?" and so on. I have tried everything I know, thats why I'm asking for help here.

Feel the lag yourselves at IP: building.kalops.se

I am running 2 other smaller servers and they have no lag what so ever.

Server spec:
i7 870
16GB DDR3 1333mhz ram
500GB storage disk (HDD WD green)

Hope you know what could be wrong.
Thanks for reading!
- TewDIE

EDIT: I am running Ubuntu 11.04 desktop. and craftbukkit 803 (had the lag since 766)

 

I used to have ~30 sec lag on my server, it was caused by 30k mobs not despawning. try limiting mobs with a plugin (I forgot the name of it)
Sorry if you have already tried it, but yeah...

edit: a good way to find out if this is the cause is to do /butcher 1000 in worldguard/worldedit (I don't remember which of these 2, i thought worldedit) and check if theres a bulk of mobs

 

@TewDIE Yeah, try /butcher 1000 first to see if it actually is the mobs. You'll need to install WorldEdit first, though. Also, try using "top" from the command line and posting the output here.

 

ok i have the exact same problem as you are having. i get little lag spikes every few seconds which causes some blocks to reapear and the time is all messed up. day/night cycle can take double what it should, smelting items takes forever and people say that stuff doesnt flow correctly in water either. picking up blocks also can take 10 seconds or so (only when i have over 20 players or so on)

I have tried loads of stuff like removeing certain plugins that are not essential to running the server. i have tried updating to java 7 and nothing is working. i started to notice this problem once i moved servers. The current server is windows server 2008 R2 and is dedicated server the old one was debian vps it may be nothing to do with the opertaing system but i must ask you. what operating system do you use on your server that lags ? and what operating system is on your other server that doesnt lag?

ill come on your server later when i get off work to see if its the exact same issue as i am having.

 

this sounds like exacty what Im having!
could turning off mobs potentially help as a test too?

 

I will try turning them of completely. Once about a month ago we had that issue I always try doing /butcher 10000 if the server lags but that time a month ago I killed 3500mobs. now days its only around 160.

Anyway the lag builds up. (forgot to say that.)
Gets worse and worse and after about 2 hours its at climax then it just lags the same all the time.

btw I'm running Ubuntu 11.04 desktop (Alot of issues started after I updated from 10.10 but nothing like this.)
And no I dont want help with Linux I want help with my server so please no whine about me using a desktop version.

 

Uhhhh...*Googles*

Okay, open console and then use "top" when the server is lagging a lot. Also (just testing a theory), can you post your BigBrother configuration file (../plugins/BigBrother/BigBrother.yml)?

Offtopic: Also, cool server; wandered around for a bit and saw some interesting sights.

 

I have tried to run the server without any plugins. The lag is still there. Also the other 2 servers is running bigbrother just fine. And yes its in MySQL mode

We might just reset the whole thing since I cant find the problem. But it would be really nice to know what the problem were so we can avoid it the next time. I will keep trying for a little while longer. But 1.6 might see a map reset for Kalops main server

Answer to AgentKid's Offtopic: Well thanks I've worked my ass off to keep the sights neat

I might add that the server is lagging even without anyone online.

EDIT by Moderator: merged posts, please use the edit button instead of double posting.

 

Maybe you have done this already, but backup your current world and try making an temp new map and see if it still lags
if it still lags then bukkit is causing it, if not theres something wrong with the world

 

I might actually have fixed it. Not 100% what fixed it but. I added the server to a ramdisk then I reconfigurated bigbrother with a new fresh mysql database.

So far its faster than ever.

Also turned off Minecart mania. (I smell bad things coming from it)

 

What do you launch your server with? The lag stacking could mean bad garbage collection.

 

mm automations are crazy intensive, leave them off

 

Not using automations tho :/

 

Same problem, found out it was BigBrother's problem. You fixed it the same way I fixed it (by clearing out the database), but there are alternatives if you were wondering:

• Change the config in BigBrother to monitor less stuff
• Change the config so the data gets deleted at an earlier time
• Switch completely/partially to LobBlock (I've found it alot less lag intensive)
• Change the delay for the pass to the database in the config to a longer time