Is anyone having issues with plugins or maybe it's craftbukkit lag?

1. What OS are you using (Brand and version - Ex. Windows XP SP3)?
CentOS 5

2. What architecture is the OS you are running (x64 or x86)?
x64

3. What version and architecture is your java install? (Type: java -version in command prompt.)

Java 1.7 Beta umm Jan 20th build I think that is 126?

4. What build of CraftBukkit are you running? (do NOT say latest. Say the build number.)
I'm not using Latest I'm using Head If were going be Luke then 159.

5. What command are you using to run your CraftBukkit server?
Simple I have tried complex nothing seams to prevent this lag issue so I will not bother sharing it all unless you have a suggestion that could change performance by 100% hehe. Just using 4gb switches.

6. What plugins are you running?
WorldEdit, WorldGuard, Essentials, BorderGuard

7. What error are you getting (post your server.log file if possible)?
No error the issue I am having is extream lag when generating new chunks and such. I don't even know what the main error is yet but I was able to hold about 90+ on 1.1 without lag and many plugins. I can barly hold 30 without lagging a lot and getting spammed with can't keep up errors. To make it worse I got a new server a i7 2600k with 16 gigs of ram to test it and same issue..


8. What have you tried already?
2 different servers, Java 1.6 and 1.7 tons and tons (10+) what are they called java switches or flags and such. TBH I don't know what to do I use to be able to run a smooth server with man plugins and Minecarts scattered around and now I can't run a small test server.

I'm even using Ramdrive so my I/O usage is not a issue...



And this spams a lot and this was with 4 people on:

2011-01-27 13:03:10 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 13:03:20 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 13:03:30 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 13:03:42 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 13:03:57 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?

 

Fill this out.

 

Thanks redone it

an example of what happens in console:

WITH PLUGINS:

Code:

2011-01-27 14:27:04 [INFO] <somefusion> im going to make a youtube video
2011-01-27 14:27:05 [INFO] Pachein lost connection: disconnect.quitting
2011-01-27 14:27:05 [INFO] baardie [/xxxxxxxx:53752] logged in with entity id 1165215
Player count: 8
2011-01-27 14:27:05 [INFO] Ruben94 [/xxxxxxxxxx:65275] logged in with entity id 1165439
Player count: 9
2011-01-27 14:27:11 [INFO] Freed 1105.2098388671875 MB.
2011-01-27 14:27:08 [INFO] Freed 1087.1033401489258 MB.
2011-01-27 14:27:11 [INFO] Fr4nc15 lost connection: disconnect.quitting
Player count: 8
2011-01-27 14:27:11 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:27:14 [INFO] Freed 375.34861755371094 MB.
2011-01-27 14:27:15 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:27:21 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:27:26 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:27:36 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:27:37 [INFO] near5555 lost connection: disconnect.quitting
2011-01-27 14:27:40 [INFO] Freed 248.5322723388672 MB.
2011-01-27 14:27:41 [INFO] near5555 [/xxxxxxx:51132] logged in with entity id 1166895
Player count: 8
2011-01-27 14:27:48 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:27:52 [INFO] [PLAYER_COMMAND] near5555: /home
2011-01-27 14:27:58 [INFO] Disconnecting /xxxxxxxx:53750: Took too long to log in
2011-01-27 14:28:06 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:28:17 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:28:21 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:28:25 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:28:29 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:28:29 [INFO] Pozzuh lost connection: disconnect.quitting
2011-01-27 14:28:31 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:28:42 [INFO] Freed 920.4210357666016 MB.
2011-01-27 14:28:42 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:28:52 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:28:57 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:29:01 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:29:06 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:29:18 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:29:51 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:29:54 [INFO] near5555 lost connection: disconnect.quitting
2011-01-27 14:29:54 [INFO] near5555 [/xxxxxxxxxxx:51200] logged in with entity id 1174415
Player count: 7
2011-01-27 14:29:55 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:29:59 [INFO] Freed 828.6107635498047 MB.
2011-01-27 14:29:59 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:30:09 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:30:11 [INFO] baardie [/xxxxxxxxx:54389] logged in with entity id 1175998
Player count: 7
2011-01-27 14:30:13 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:30:17 [INFO] Freed 161.54084014892578 MB.
2011-01-27 14:30:18 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?

WITHOUT PLUGINS:

Code:

Player count: 4
2011-01-27 14:44:13 [INFO] chrismack tried command: who
2011-01-27 14:44:18 [INFO] <somefusion> lol ant to be in it?
2011-01-27 14:44:21 [INFO] m4w11 [/xxxxxxxx:51963] logged in with entity id 60973
Player count: 5
2011-01-27 14:44:33 [INFO] crutonxx lost connection: disconnect.timeout
2011-01-27 14:44:46 [INFO] crutonxx [/xxxxxxxxxxx:53024] logged in with entity id 62351
Player count: 5
2011-01-27 14:44:54 [INFO] oboehello [/xxxxxxxxxxx:52708] logged in with entity id 62592
Player count: 6
2011-01-27 14:44:59 [INFO] iiZend [/xxxxxxxxxxx:56663] logged in with entity id 62606
Player count: 7
2011-01-27 14:45:01 [INFO] <crutonxx> il give you a torch as a peace offering
2011-01-27 14:45:05 [INFO] iiZend tried command: help
2011-01-27 14:45:07 [INFO] <iiZend> hey?
2011-01-27 14:45:15 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:45:15 [INFO] <somefusion> i'll give you some dirt
2011-01-27 14:45:15 [INFO] <m4w11> zomg
2011-01-27 14:45:15 [INFO] <iiZend> Kane?
2011-01-27 14:45:21 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:45:21 [INFO] <somefusion> (thats the only thing i have)
2011-01-27 14:45:25 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:45:27 [INFO] <m4w11> :O
2011-01-27 14:45:29 [INFO] <crutonxx> i only have torches
2011-01-27 14:45:35 [INFO] <crutonxx> 3 of them
2011-01-27 14:45:45 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:45:50 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:45:50 [INFO] oboehello lost connection: disconnect.quitting
2011-01-27 14:45:51 [INFO] <somefusion> kan'es ofline D:
2011-01-27 14:45:57 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:45:57 [INFO] iiZend lost connection: disconnect.quitting
2011-01-27 14:46:12 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:46:20 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:46:21 [INFO] <somefusion> btw
2011-01-27 14:46:25 [INFO] crutonxx [/xxxxxxxxxx:53041] logged in with entity id 66574
Player count: 5
2011-01-27 14:46:28 [INFO] <somefusion> i could of sworn i saw herobrine
2011-01-27 14:46:36 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:47:01 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 14:47:01 [INFO] <somefusion> :O
2011-01-27 14:47:07 [INFO] <somefusion> *music: DUN DUN DUNNNN*

 

Run the server with this command instead, and see if its any better. I know you said you tried many different commands, but you didn't list which ones, so I'm just throwing this out there:

java -d64 -Xincgc -Xmx4G -jar craftbukkit.jar nogui

If you have enough ram, lets go into overkill mode:
java -d64 -Xincgc -Xmx12G -jar craftbukkit.jar nogui

In your system monitor (or top, or whatever you use) is there any notice of RAM usage? CPU usage? Anything that stands out?

Have you tried running it without plugins? With a new world?

 

Thanks TnT I edited above post I did try without Mods still same issue.. Here is doing your overkill mod since I got more then enough ram:

At the bottom hit enter a few times to see if there was lag and ass you can see there was it took like 4-5 secs then it spam no command.

Code:

2011-01-27 15:08:15 [INFO] hande lost connection: disconnect.genericReason
2011-01-27 15:08:17 [INFO] Freed 40.70887756347656 MB.
2011-01-27 15:08:18 [INFO] <Jollesollepolle> the main minecradft guy
2011-01-27 15:08:21 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:08:28 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:08:28 [INFO] <Jollesollepolle> minecraft
2011-01-27 15:08:36 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:08:40 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:08:52 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:08:52 [INFO] <somefusion> what?
2011-01-27 15:08:52 [INFO] <somefusion> you meen the defult skin?
2011-01-27 15:08:56 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:08:56 [INFO] <somefusion> or?
2011-01-27 15:08:56 [INFO] <somefusion> .............
2011-01-27 15:09:00 [INFO] <Jollesollepolle> yeah
2011-01-27 15:09:06 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:09:12 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:09:13 [INFO] <somefusion> ...um yeah... your in defult skin
2011-01-27 15:09:16 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:09:34 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:09:34 [INFO] <Jollesollepolle> DOH

2011-01-27 15:09:34 [INFO] Unknown console command. Type "help" for help.
2011-01-27 15:09:34 [INFO] Unknown console command. Type "help" for help.
2011-01-27 15:09:34 [INFO] Unknown console command. Type "help" for help.
2011-01-27 15:09:34 [INFO] Unknown console command. Type "help" for help.
2011-01-27 15:09:37 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?

--- merged: Jan 27, 2011 8:13 PM ---
Here more info in top:

20221 godcraft 20 0 8797m 359m 9824 S 57.6 2.2 1:50.46 java

load average: 0.62, 0.43, 0.29


There is like 5 people online IDK what to do.

 

I'm not sure I do either.

What path is your craftbukkit installed to (important for the second question)? What's your /etc/fstab look like for your ramdisk? How large is your world folder? Did you try a new world?

 

Thanks for getting back to me. My World folder is 100% empty this is a test server so I started fresh I guess now it be 20mb or so.


I decided to try vanilla and it seams that even that causes heavy lag but why could I run 1.1 with hmod and have 90 players but with 5 players I lag like a bitch hehe.

Code:

011-01-27 15:29:09 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:29:24 [INFO] thomasalright tried command: who
2011-01-27 15:29:24 [INFO] thomasalright tried command: who
2011-01-27 15:29:25 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:29:46 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:29:46 [INFO] <somefusion> hi
2011-01-27 15:29:51 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:29:54 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:30:01 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:30:01 [INFO] <thomasalright> hallo
2011-01-27 15:30:09 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:30:17 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:30:17 [INFO] <nurrd> hi
2011-01-27 15:30:29 [INFO] <somefusion> LOL
2011-01-27 15:30:35 [INFO] <somefusion> SssssSss
2011-01-27 15:30:52 [INFO] <somefusion> im a creeper in a suit
2011-01-27 15:31:01 [INFO] <thomasalright> i c
2011-01-27 15:31:50 [INFO] darkreynir lost connection: disconnect.quitting
2011-01-27 15:31:53 [INFO] darkreynir [/xxxxxxxxx:54355] logged in with entity id 296583
Player count: 5
2011-01-27 15:31:58 [INFO] jcdevelopment [/xxxxxxxxxx:38756] logged in with entity id 302315
Player count: 6
2011-01-27 15:32:01 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
Player count: 6
2011-01-27 15:32:09 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:32:16 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:32:21 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:32:25 [INFO] darkreynir lost connection: disconnect.quitting
2011-01-27 15:32:28 [INFO] darkreynir [/xxxxxxxxxxxx:54369] logged in with entity id 331613
Player count: 6
2011-01-27 15:32:36 [INFO] LimitedEdition [/xxxxxxxxxxxxx:63134] logged in with entity id 339778
Player count: 7
2011-01-27 15:33:01 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:33:01 [INFO] nurrd lost connection: disconnect.quitting
2011-01-27 15:33:03 [INFO] jcdevelopment lost connection: disconnect.quitting
Player count: 5
2011-01-27 15:33:16 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:33:17 [INFO] jcdevelopment [/xxxxxxxxxxx:62821] logged in with entity id 362809
Player count: 6
2011-01-27 15:33:21 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:33:25 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:33:25 [INFO] nurrd [/xxxxxxxxxxxx:50581] logged in with entity id 367689
Player count: 7
2011-01-27 15:34:01 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:34:01 [INFO] /xxxxxxxxxxxxx:54405 lost connection
2011-01-27 15:34:02 [INFO] darkreynir lost connection: disconnect.quitting
2011-01-27 15:34:03 [INFO] darkreynir [/xxxxxxxxxxxxxx:54408] logged in with entity id 374155
Player count: 7
2011-01-27 15:34:06 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:34:26 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
2011-01-27 15:35:04 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?

Code:

LABEL=/                 /                       ext3    defaults,usrquota,grpquota      1 1
LABEL=/home             /home                   ext3    defaults,usrquota,grpquota      1 2
LABEL=/usr              /usr                    ext3    defaults        1 2
LABEL=/var              /var                    ext3    defaults        1 2
LABEL=/boot             /boot                   ext3    defaults        1 2
devpts                  /dev/pts                devpts  gid=5,mode=620  0 0
sysfs                   /sys                    sysfs   defaults        0 0
proc                    /proc                   proc    defaults        0 0
LABEL=SWAP-sda7         swap                    swap    defaults        0 0

# Modified by BurstNET Technologies, Inc. for additional security
LABEL=/tmp            /tmp       ext3  defaults,nosuid,noexec     1 2
tmpfs            /dev/shm     tmpfs        defaults,nosuid,noexec   0 0

Code:

Filesystem           1K-blocks      Used Available Use% Mounted on
/dev/sda5              2030736    465904   1460012  25% /
/dev/sda8            904861916    220356 857935788   1% /home
/dev/sda3             10154020   2220600   7409300  24% /usr
/dev/sda2             10154020    323004   9306896   4% /var
/dev/sda1               101086     32509     63358  34% /boot
/dev/sda6              1019208     36792    929808   4% /tmp
tmpfs                  8232192         0   8232192   0% /dev/shm
none                   6291456     35860   6255596   1% /home/godcraft/ramdisk

Craftbukkit is installed /home/godcraft/ramdisk

 

Well, if its happening in Vanilla there isn't much we can do. Why is it doing it? Probably something mojang changed in the code between 1.1 and 1.2.

As for the files, I'm going to claim ignorance on CentOS. I just don't play with it at all. I'll get my centos admin friend to check it out, see if he has any ideas.

I really don't know what to say. My server specs are absolute shit compared to yours and I don't get this problem. Maybe one of the Bukkit devs can comment?

 

I'm going to actually Blame CentOS but not them directly the current company. Looks like they have a none Generic Kernel installed causing segfaults.

I will investigate on this and report back!
--- merged: Jan 27, 2011 10:34 PM ---

This has been addressed it was all to do with Burst.Net installing I guess there own modified kernel that caused panics and caused the massive lags through java.

It's been set back to generic kernel and now is running smooth with 12+ people and Not a single alert.

Thanks for your help TNT!

 

Hey Kane,
Nothing glaring with what you have posted to indicate why. But without being able to poke around can I ask a for the output of a few commands to try and find out where this bottleneck might exist. All of these commands while the server is running. Well except for java, can do that anytime.

• Code:

  $ java -version
    $ free -m
    $ vmstat -S M 5 5
    $ iostat 5 5
    $ sar -b (only need the entries since server was running)
    $ sar -B  (only need the entries since server was running)
    $ tail -50 /var/log/messages   (anything funky in there?)

Also I noticed in your fstab that Burstnet changed your entires. Is this by chance a VPS solution or some other virtualized environment that might be dynamically adjusting your hardware?

Does a yum update have any patches or kernel updates available for you?

Code:

# yum update

 

Sounds awesome. Can you write up what you did so anyone else having that problem can correct it?

Thanks for jumping in user7 (he's my CentOS expert).

 

was just editing grub.conf switched into the generic centOS kernel and reboot. This happen in the past I forgot all about it sort of and then I thought of the reboot errors lol:

This is from the PAST:

Code:

==================
Nov 15 19:05:25 server kernel: [25978.991891] grsec: From 71.251.229.148: Segmentation fault occurred at 00007f7a71026000 in /usr/lib/jvm2/bin/java[java:14608] uid/euid:500/500 gid/egid:500/500, parent /home/godcraft/ramdisk/server_nogui.sh[server_nogui.sh:14592] uid/euid:500/500 gid/egid:500/500
Nov 15 19:05:26 server kernel: [25979.521125] grsec: From 71.251.229.148: Segmentation fault occurred at 00007f7a71026000 in /usr/lib/jvm2/bin/java[java:14608] uid/euid:500/500 gid/egid:500/500, parent /home/godcraft/ramdisk/server_nogui.sh[server_nogui.sh:14592] uid/euid:500/500 gid/egid:500/500
Nov 15 19:05:26 server kernel: [25979.522128] grsec: more alerts, logging disabled for 10 seconds
Nov 15 19:05:46 server kernel: [25999.437988] grsec: From 71.251.229.148: Segmentation fault occurred at 00007f7a71025280 in /usr/lib/jvm2/bin/java[java:14602] uid/euid:500/500 gid/egid:500/500, parent /home/godcraft/ramdisk/server_nogui.sh[server_nogui.sh:14592] uid/euid:500/500 gid/egid:500/500
Nov 15 19:07:04 server shutdown[15308]: shutting down for system reboot
Nov 15 19:07:34 server init: Switching to runlevel: 6
================== 

 

I'd be interested to see what they did to the kernel to cause that issue.

 

I'm not sure burst.net servers had some silly modified kernel I can't really say much I'm not a pro but we had 30+ online today with full settings on and fine.

Now to tweak things up is suggestions to this:

java -d64 -Xincgc -Xmx12G -jar craftbukkit.jar nogui

 

user7 is about as much of a pro as it comes when you talk about CentOS or RedHat. Hence his curiosity.

Go nuts, that's going to be a kick ass server. Send me your IP

 

i replied in stickied post at the top...


just tried running the server again, within 44 seconds i was getting the warning

 

Same. Spams my log.

Really pissing me off....

 

Exactly the same? Same hardware, OS, java?

 

I doubt you have this issue. This was a kernel issues your probably having this issue do to I/O usage.