I am running it on my Linux VPS. How would I go about updating bukkit to the newest recommended build?
delete the craftbukkit.jar and replace it with this one: http://ci.bukkit.org/job/dev-CraftBukkit/617/
Yes, for updating craftbukkit. But notice that some plugins will be broken and then you will also need to update the plugin.jar of each one.