I have a different tolerance for trees out "on the back 40" than hanging over the garage I park my Mustang in or my kid's bedrooms.
Out on the back 40 I'd let that go forever. At worst it will end up neat and hollow.
Did we decide on black walnut? Those have pretty darned good structural...