Let's see, an electron and a positron ahve the same mass. Does that mean
there is no difference between them. Obviously they differ in some other
physical properties.
Torque and Work/Energy have the same UNITS but they have very different
PHYSICAL MEANING and that's what counts. Not only that, but in this case
at least, they also differ in other properties; e.g., one is a scalar while
the other is a (pseudo-)vector.