Dropping a strip of 1/4" flat bar that fits snugly inside the uprights on the panther mill, centering it roughly and welding it at the top and bottom fixes the problem completely, and makes the single bolt clamp work about as well as can be reasonably expected.
I drew it up real quick to show...