Whoever is following you is most likely doing /find chitraksh (or whatever your IGN is). To disable this, you can go to the lobby or any server and type /settings.
If they are still following you, make sure the player is on tab, it could be a /tellraw command, and you can check the logs on the website to see if anything suspicious is happening.
You can also whitelist your server by doing /whitelist on, then doing /whitelist add (players)
Hope these tips help!
(also dont post this in skript discussion and this is not related to it at all)