The expression is probably an allusion to the fact that if you over sharpen a tool the point can break off, leaving you with a usefles too. The same can apply to an argument, too much detail can reduce the force of the argument.

I have also seen the expression mean "to be blunt about it..." In this case, I guess the metaphore could be, why use a dagger when a club will do?

Jon