If you are running a Unity gameserver, then you should ensure that you are running your gameserver with the following Command Line Parameters:
-batchmode -nographics
This is to prevent the gameserver from attempting to generate a GUI on the CPU, which requires a high amount of CPU resources.
If you find that this does not resolve the issue, the next step would be to check out your gameservers framerate.