I think "per se" is just a way of achieving wiggle room, like saying "to the best of my recollection" when in court. Hardly anyone, including me, knows its latin origin or what it is really supposed to mean. Latin scholars?