While the definition you propose works, it by its nature fails to differentiate between the two separate types of critical points. While both Stationary Points (those with zero slope) and undifferentiable points are critical points, the have different properties and implicates for the nature and continuity of the function, and the presence of maxima/minima. Your definition fails to make the distinction (without looking at the derivative, which reduces to the standard definition.
Additionally, observing the derivative itself near critical values can tell us more about the nature of those points, while your definition fails to provide additional information with more calculation.
It's a good thought, but its seems that, in practice, such a definition would be inferior to the current standard.