Go to
File Manager > Plugins > SuperVanish > config.yml
In config.yml, there will be an option for fly. It will look like this:
Fly:
# Should invisible players be able to fly even if they aren't in creative/spectator mode?
Enable: true
# Should invisible players WITHOUT the permission 'sv.keepfly' lose the ability to fly on reappear?
DisableOnReappear: true
This setting, "# Should invisible players be able to fly even if they aren't in creative/spectator mode?
Enable: true," switch it to false. Don't change anything else. You're done!