A probabilist can tell you that getting 100 heads in a row is no less likely than any other outcome when tossing a fair coin 100 times. A statistician will suspect the coin is biased.
Statistics is a discipline that relies heavily on mathematics, but is not within mathematics.
For example, consider the Behrens–Fisher problem: What should one infer about the difference between the means of two normally distributed populations, which may have different variances, when one observes a random sample from each?
Bartlett criticized Fisher's "fiducial" solution to this problem on the grounds that Fisher's fiducial intervals are not confidence intervals, i.e. they don't have constant coverage rates. That is certainly a mathematical fact. But Fisher disputed the idea that they ought to have constant coverage rates. That's essentially a philosophical position. Suppose you had prior probability distributions on the means and variances of the two populations, and then asked what's the conditional distribution of the difference between the two means, given the observed samples? That's just a math problem, and the posterior probability intervals that you get don't have constant coverage rates, so under some circumstances it clearly makes sense not to have constant coverage rates. Just which of several math problems should be used to model the Behrens–Fisher problem? That's more akin to a philosophical question than to a math problem. It's certainly not itself a mathematical question. But in a sense, it is the Behrens–Fisher problem.