Try uninstalling the modpack, and rejoining the server. I have not tested with modpacks yet, but if you are able to get in without the modpack, it is an issue with the modpack and the server.
If the above is the issue, make sure you are using the same minecraft version for both server and modpack, as well as the same minecraft version to join the server.