Specifically, the Paris-Harrington theorem.
In what sense is it true? True in Peano arithmetic but not provable in Peano arithmetic, or true in some other sense?
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It only takes a minute to sign up.Sign up to join this community
Peano Arithmetic is a particular proof system for reasoning about the natural numbers. As such it does not make sense to speak about something being "true in PA" -- there is only "provable in PA", "disprovable in PA", and "independent of PA".
When we speak of "truth" it must be with respect to some particular model. In the case of arithmetic statements, the model we always speak about unless something else is explicitly specified is the actual (Platonic) natural numbers. Virtually all mathematicians expect these numbers to "exist" (in whichever philosophical sense you prefer mathematical objects to exist in) independently of any formal system for reasoning about them, and the great majority expect all statements about them to have objective (but not necessarily knowable) truth values.
We're very sure that everything that is "provable in PA" is also "true about the natural numbers", but the converse does not hold: There exist sentences that are "true about the actual natural numbers" but not "provable in PA". This was famously proved by Gödel -- actually he gave a (formalizable, with a few additional technical assumptions) proof that a particular sentence was neither "provable in PA" nor "disprovable in PA", and a convincing (but not strictly formalizable) argument that this sentence is true about the actual natural numbers.
Paris-Harrington shows that another particular sentence is of this kind: not provable in PA, yet true about the actual natural numbers.
The Paris-Harrington theorem is actually the theorem that states that the strengthened [finite] Ramsey theorem is unprovable in first-order Peano Arithmetic.
However, since the Ramsey theorem is provable in second-order arithmetic, and therefore true in the standard model of Peano arithmetic, we can say that the theorem is true in a very deep and concrete sense.
Generally speaking, when we say a statement about the integer is true we mean that it is true in the standard model, which is the model of second-order Peano arithmetic, and it is all the numbers which can be generated by finitely many iteration of the successor function from zero. (Non-standard models of first-order PA exist, and there are non-standard integers which cannot be generated by finite iterations of the successor from zero.)
You may also want to read this thread about the difference between truth and provability.
The other answers are excellent, but I would like to point out that Peano arithmetic is a particularly bad first example for understanding the distinction between truth and provability because
So let's pick a better example where there's no possibility of confusion: the first-order theory of groups. I'm not going to spell out in detail what this is; consider it an exercise to write it down in full. After writing down the language of groups, write down the group theory axioms.
"Provable" has an unambiguous meaning here: it means "provable from the axioms of group theory." By the completeness theorem, this is equivalent to "true for all groups."
"True" is meaningless here unless you take it to mean "true for all groups," which is not the sense in which the Paris-Harrington theorem is true. What is meaningful is to say that a statement in the language of groups is true in a particular model: for example, the statement
$$\exists g : g \neq e, g^2 = e$$
is true in a group $G$ precisely when that group has a nontrivial element of order $2$.
The difference between group theory and first-order Peano arithmetic is that when it comes to Peano arithmetic, mathematicians have a special model that they really like, namely the "actual natural numbers," and "true" in this context means "true of this special model." As Asaf says, one way to define this model is as the unique model of second-order Peano arithmetic; however, first-order Peano arithmetic does not have a unique model (e.g. by upward Löwenheim-Skolem).
This is very different from the situation with group theory; nobody has a group $G$ that they like so much that they would define "true" to mean "true of $G$"!
As a final remark, note that by the completeness theorem, "true of the actual natural numbers but not provable" is equivalent to "true of the actual natural numbers but false for some other model of Peano arithmetic." This may seem like a strange state of affairs, but the analogous situation in group theory ("true of some group but false of some other group") is not so strange.
You seem to be confused about the meaning of true when it comes to peano arithmetic. Peano arithmetic usually refers to a particular set of axions about the natural numbers, formalized in first-order predicate logic.
If you have a statement $A$ and a set of axioms $T$ it can be that
In the case of PA, people might also say "True over the integers" or simply "true" instead of "True over the standard model of PA". Especially because PA is not the only axiomatization of the integers.
The generalized Ramsey theorem (sometimes called Paris-Harrington Principle, btw) is not provable in PA, but it is true in the stanard model of PA, i.e. in the usual integers. We know that because it is provable in second-order arithmetic, i.e. a second-order axiomatization of the integers.
Note that (according to Wikipedia) the proof of the Paris-Harrington theorem goes by assuming it is true in Peano arithmetic and showing this can prove Peano is consistent (within Peano).
Because Gödel has shown this is not possible, it must not be possible to prove the theorem in Peano.
So as far as understanding it, you can fall back on Gödel: he showed there are statements in a formal theory that cannot be proved (or disproved) by that theory but are true in a formal theory with more axioms. This is one of those statements for Peano.