If your internet connection has not been randomly cut out yet, they probably don't have your IP address or don't even know how to do anything with it. However, if you are still worried and want to make sure that they don't have your IP address follow these steps to get a new one (windows 10):
1. Type "cmd" in your windows search bar - open command prompt
2. In the command prompt, type "ipconfig /release" and hit enter
3. Type "ipconfig /renew" and hit enter
Done! you have a new IP address.