Bukkit and EXTREME lag spikes

Ok, I have done everything in my power to determine the cause of these lag spikes. They come without warning or error.

They only happen when someone logs in or logs out though.

I have tried with a clean Bukkit, no plugins and have tried one at a time but it is too confusing with the traffic constantly going to figure it out ._.

On a side note, essentials /modgrp restarts the server when I use it. Is there a way to disable this?

Here is my setup!

System Specs

• DamnVPS VPS
• 2gb Ram
• 4 core 2.3 Ghz Xeon
• 65 GB Hard Drive
• Windows Server 2008 RC2
• System uses 21-25% ram WITHOUT Bukkit running
• Apache Server and MySql Server
• TeamSpeak 3 Server
• 100mbit connection usually 50mbit up and down
• No virus or malware protection and the firewall is not stopping any of it

Bukkit

• build 328
• Nether newly created
• World is 1.2 GB
• Wrapped by Remote Toolkit
• Set for 1g ram

Plugins (This is a long list!)

• NUkkit (Obviously
• Achievements
• AfkKick
• Authorize
• BackupPlugin
• BasicCircuits-0.8
• BlockDrops
• BlockPush
• BukkitTCPServer
• Cleaner
• ControllerBlock
• CraftIRC
• DeathChest
• DeathTPPlus
• dynmap
• EekRunes
• Essentials
• EssentialsBan
• EssentialsHelp
• EssentialsHome
• EssentialsSpawn
• EssentialsTele
• EssentialsWarp
• FarmMaster
• FenceStack
• HeroBounty
• iAuction
• iChat
• iConomy
• iMonster
• JSONApi
• LastCommand
• LevelCraft
• LightVote
• LogBlock
• LWC
• MagicCarpet
• marklog
• milkAdmin
• MinecartManiaChestControl
• MinecartManiaCore
• MinecarManiaSignCommands
• MinecartManiaStation
• MinecraftRkitPlugin
• MonsterHunt
• MoveCraft
• MsgReply
• NPCTrader
• Permissions
• Persistence
• PetitionPlugin
• PrivateWarp
• PvP
• RedstoneChips-0.8
• RepairShop
• Reputation
• RuneCaster
• SearchIds
• SensorLibrary-0.11
• ServerEvents
• SignColours
• SignLift
• SlowHealth
• Spells
• Stats
• Towny
• UnknownCommand
• Vanish
• Wand
• WarnFreeze
• WorldEdit
• WorldGuard

Thank you for the time! If you know any issues with any of these plugins if you could post them that would be great!

 

First thing thy strikes me is that's a lot of stuff running on 2gigs of ram for server 2008.

Would you mind creating a java garbage collection log while your server is running until you notice the lag.

Add this to your launch line

Code:

-verbose:GC -XX:+PrintGCDetails -Xloggc:garbagecollection.log 

Post the log file from your craftbukkit folder.

How many users?
Also I had a lot of issues with essentials. I Ditched it and found alternatives. Server is better than ever.

 

will do now thanks.

 

what kind of issues did you have with essentials? curious cause i use em.

 

Here it is for ya, The thing about the ram is, is that milkAdmin tells me I always have about 200-400 mb free of ram out of the 1g allotted.

I will seriously rip out every windows service that is useless (did with a good bit already) to fix this lag!

I have 19-25 users on at a time with the highest being 35

i use java -verbose:GC -XX:+PrintGCDetails -Xloggc:garbagecollection.log -Xincgc -Xmx1024M -jar craftbukkit.jar nogui

I tried -d64 but get an unrecognized option error. I am using jre and jrk both 6_24 and both 64bit

 

What is your CPU and RAM usage under full user load?
Do you have mobs and animals enabled?

Replace your line with this one and repost another log file. This should start the server with a slightly higher priority and with a different low pause garbage collector. It also ups the ram to 1.5gb

Code:

START /B /abovenormal java -server -verbose:GC -XX:+PrintGCDetails -Xloggc:garbagecollection.log -Xmx:1536M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:+CMSParallelRemarkEnabled -XX:+DisableExplicitGC -XX:MaxGCPauseMillis=100 -XX:ParallelGCThreads=3 -Xnoclassgc -XX:UseSSE=3 -XX:+UseAdaptiveGCBoundary -jar craftbukkit.jar

How much would your VPS provider charge for more RAM?
--- merged: Feb 19, 2011 12:48 PM ---

Server performance was being erratic and it was conflicting with my other plugins commands. They have started splitting out functionality into seperate plugins so it should be less of an issue now. Most of the basic functionality is already built into scrap-bukkit and everything else can be found in a stand alone plugin that is probably more flexible/powerful anyway.

 

I get a little lag spikes only when people login. I just figured it was normal.

 

I am trying the command now. An I am going to puchase another gig of ram considering that for $10 USD i get more bandwidth, cpu power and harddrive space anyways!
--- merged: Feb 19, 2011 4:09 PM ---
ah btw
-Xmx:1536M
needs to be
-Xmx1536M
other wise it throws invalid heap size errors.

 

-Xmx:1536M
needs to be
-Xmx1536M
Doh! Serves me right for trying to do it from memory.

Also, could you include -XX:+PrintGCTimeStamps ?
I'm going to try a log graphing app and it requires the time stamps as well.

 

yah i will then
--- merged: Feb 19, 2011 5:08 PM ---
Yeah I am not going to be able to do that, this created such an EXTREME amount of lag it even lagged out my vnc. Will the current logs do? I cant afford the down time ._.
--- merged: Feb 19, 2011 5:19 PM ---
Yeah infact that CRASHED my vps

 

:s yes the original logs will be fine, i'll be able to see anything out of the ordinary from just looking.

I also wonder if 1.5 gigs is asking too much from the rest of the system. reduce it to 1 gig again maybe.

 

Just a little side note: The Stats plugin tend to well, give a huge performance issue after some time of running. Has been confirmed several times over now.

 

I removed stats, added the -server tag, and only have 3 people on and it lags to hell to the point of unplayability EVERY time someone logs in or logs out.

Thanks for the help guys but I will no longer be spending full valentines days, full 22 hour days or anything trying to fix something.

 

I'd give the ram upgrade a shot and try to scale back plugins.

I understand your frustration though.

 

I loaded it up with NO PLUGINS and with 3 people it would lag like hell on logins and logout

 

Your world is pretty huge at 1.2 gigs. Try starting a fresh world and see if it still happens.

 

My players would kill me and with how it loads chunks would a world size really be an issue? Is there a tool to trim untouch parts?
--- merged: Feb 19, 2011 7:28 PM ---
meaning without manually selecting a couple hundred things

 

It's worth a shot to try and narrow the problem down.

If it is the case, MCEdit can prune a map down to a selection. In your case it would be a pretty time consuming process because of the size, but it might be doable. There may be other tools as well.

 

on a second note MOST other lag disapeared with Authorize
--- merged: Feb 19, 2011 7:51 PM ---
DONT USE AUTHORIZE!

 

That makes sense... lag on login... authorize is a login plugin...

Keep it up! The process of elimination will get you there eventually.

 

I still get lag on login but its not continuous or horrendous as it was
--- merged: Feb 19, 2011 7:58 PM ---
will more ram solve me not wanting to change the world file?

 

More RAM will help. You are starved for it right now with all the things running on that server.

You may want to just test with a fresh world to see if it even makes a difference. It may not.

Plus, a smaller world is easier to backup.

I'd look into alternatives for essentials too, I found a reduction in lag after removing it.

 

ah god but i love plugin control and tpa/tpahere

 

Look at Teleplus for teleport usage. Plugin control will be built in eventually.

 

So I switched to ubuntu x64, added 1.8g of ram and run it now I get EXTREME cpu spikes, any ideas? (running 432 now)

 

Wait, are you talking about lag when you teleport around - world loads slowly, etc? If so, that's a known issue with vanilla MC.

 

I still say your vps is under speced for what you are running on it. Plus that's a lot of potentially buggy beta software to be running. Unless you are willing to systematically test each plugin one by one you may never know.

 

ubuntu server isnt memory efficient. centos can use under 100mb of ram and ubuntu normal goes over 200mb of ram.
--- merged: Mar 2, 2011 7:47 PM ---
ya ive been getting lag spikes when people join to and some major wrong block movements or w/e tried around 10 dif bukkit builds no luck.

 

Its not ram, it doesnt even use a fraction of it. It is purely cpu but my issue has settled for a bit. Someone should scrap all of this and start over recreating the server and game in c++ like an real game should be!

 

C++ doesn't solve sloppy coding. Java is a capable language, but it's only as good as the code written for it. Notch did a lot of work on his own very quickly. It's going to take a long time to unravel it and improve it. Starting from scratch might not be such a bad idea, but saying that C++ will solve everything is silly. just my two cents.

By the way, it seems that there is a bug or issue related to players logging out that occurs when the server unloads the chunks. does that sounds anything like what you're seeing?