If you enjoy the squirrels then keep feeding them. They are not going to make holes in your oak tree. Like Eric said though , if you have a hole in your limb, It may or not be a hazard. Is it a large limb and do you sit under it or do kids play under it ? Is it forming callus tissue around the outside of the hole? You can hit the tree with a rubber mallet to check for hollow wood if you have a good ear, but have a certified arborist look at it if you are unsure. If you do still feed the squirrels, which i think you should if your wife likes that , you should not let all the seed build up really thick in the "Ys" of the branches and become really wet that may predispose the bark area to rot . Let us know what you find out ok? John