Lime Tree

[MVishniako]

I have a two year old Bears Lime tree with quite a few fruit on the lower branches of the tree. The problem all the branches above the tree have small leaves and do not bear any fruit. The tree does not look good or right, is there anyway that this can be remedied?

Thanks Mike!