Try shallowing up until your not getting any indications or bites. You want your hook bait above the feeding fish. Then change your feeding pattern so that you increase the competition for your hook pellet. Feed and wait 15 seconds, then feed and wait 15 seconds, then feed again but dont feed again for 30-40 seconds. Feeding like this results in the F1s rising higher in the water pre empting the next time you feed. Your pellet being the only pellet in the water when you dont feed results in your pellet being nailed confidently with no issues with line bites from flashing or fussy fish!
Also try expanders if silvers are not part of the problem. Banding a hard pellet often works too.