Those interested in pushing this question back further than Asaf Karagila did (well past logic and into the morass of philosophy) may be interested in the following comments that were written in 1860 (full reference below). Also, although Asaf's treatment here avoids this, there are certain issues when defining addition of natural numbers in terms of the successor operation that are often overlooked. See my 22 November 2011 and 28 November 2011 posts in the Math Forum group math-teach.
$[\ldots]$ consider this case. There is a world in which, whenever two pairs of things are either placed in proximity or are contemplated together, a fifth thing is immediately created and brought within the contemplation of the mind engaged in putting two and two together. This is surely neither inconceivable, for we can readily conceive the result by thinking of common puzzle tricks, nor can it be said to be beyond the power of Omnipotence, yet in such a world surely two and two would make five. That is, the result to the mind of contemplating two two’s would be to count five. This shows that it is not inconceivable that two and two might make five; but, on the other hand, it is perfectly easy to see why in this world we are absolutely certain that two and two make four. There is probably not an instant of our lives in which we are not experiencing the fact. We see it whenever we count four books, four tables or chairs, four men in the street, or the four corners of a paving stone, and we feel more sure of it than of the rising of the sun to-morrow, because our experience upon the subject is so much wider and applies to such an infinitely greater number of cases.
The above passage comes from:
James Fitzjames Stephen (1829-1894), Review of Henry Longueville Mansel (1820-1871), Metaphysics; or, the Philosophy of Consciousness, Phenomenal and Real (1860), The Saturday Review 9 #244 (30 June 1860), pp. 840-842. [see page 842]
Stephen’s review of Mansel's book is reprinted on pp. 320-335 of Stephen's 1862 book Essays, where the quote above can be found on page 333.
(ADDED 2 YEARS LATER) Because my answer continues to receive sporadic interest and because I came across something this weekend related to it, I thought I would extend my answer by adding a couple of items.
The first new item, [A], is an excerpt from a 1945 paper by Charles Edward Whitmore. I came across Whitmore's paper several years ago when I was looking through all the volumes of the journal Journal of the History of Ideas at a nearby university library. Incidentally, Whitmore's paper is where I learned about speculations of James Fitzjames Stephen that are given above. The second new item, [B], is an excerpt from an essay by Augustus De Morgan that I read this last weekend. De Morgan's essay is item [15] in my answer to the History of Science and Math StackExchange question Did Galileo's writings on infinity influence Cantor?, and his essay is also mentioned in item [8]. I've come across references to De Morgan's essay from time to time over the years, but I've never read it because I never bothered trying to look it up in a university library. However, when I found to my surprise (but I really shouldn't have been surprised) that a digital copy of the essay was freely available on the internet when I searched for it about a week ago, I made a print copy, which I then read through when I had some time (this last weekend).
[A] Charles Edward Whitmore (1887-1970), Mill and mathematics: An historical note, Journal of the History of Ideas 6 #1 (January 1945), 109-112. MR 6,141n; Zbl 60.01622
(first paragraph of the paper, on p. 109) In various philosophical works one encounters the statement that J. S. Mill somewhere asserted that two and two might conceivably make five. Thus, Professor Lewis says$^1$ that Mill "asked us to suppose a demon sufficiently powerful and maleficent so that every time two things were brought together with two other things, this demon should always introduce a fifth"; but he gives no specific reference. {{footnote: $^1$C. I. Lewis, Mind and the World Order (1929), 250.}} C. S. Peirce$^2$ puts it in the form, "when two things were put together a third should spring up," calling it a doctrine usually attributed to Mill. {{footnote: $^2$Collected Papers, IV, 91 (dated 1893). The editors supply a reference to Logic, II, vi, 3.}} Albert Thibaudet$^3$ ascribes to "a Scottish philosopher cited by Mill" the doctrine that the addition of two quantities might lead to the production of a third. {{footnote: $^3$Introduction to Les Idées de Charles Maurras (1920), 7.}} Again, Professor Laird remarks$^4$ that "Mill suggested, we remember, that two and two might not make four in some remote part of the stellar universe," referring to Logic III, xxi, 4 and II, vi, 2. {{footnote: $^4$John Laird, Knowledge, Belief, and Opinion (1930), 238.}} These instances, somewhat casually collected, suggest that there is some confusion in the situation.
(from pp. 109-111) Moreover, the notion that two and two should ["could" intended?] make five is entirely opposed to the general doctrine of the Logic. $[\cdots]$ Nevertheless, though these views stand in the final edition of the Logic, it is true that Mill did, in the interval, contrive to disallow them. After reading through the works of Sir William Hamilton three times, he delivered himself of a massive Examination of that philosopher, in the course of which he reverses his position--but at the suggestion of another thinker. In chapter VI he falls back on the inseparable associations generated by uniform experience as compelling us to conceive two and two as four, so that "we should probably have no difficulty in putting together the two ideas supposed to be incompatible, if our experience had not first inseparably associated one of them with the contradictory of the other." To this he adds, "That the reverse of the most familiar principles of arithmetic and geometry might have been made conceivable even to our present mental faculties, if those faculties had coexisted with a totally different constitution of external nature, is ingeniously shown in the concluding paper of a recent volume, anonymous, but of known authorship, Essays, by a Barrister." The author of the work in question was James Fitzjames Stephen, who in 1862 had brought together various papers which had appeared in Saturday Review during some three previous years. Some of them dealt with philosophy, and it is from a review of Mansel's Metaphysics that Mill proceeds to quote in support of his new doctrine $[\cdots]$
Note: On p. 111 Whitmore argues against Mill's and Stephen's empirical viewpoint of "two plus two equals four". Whitmore's arguments are not very convincing to me.
(from p. 112) Mill, then, did not originate the idea, but adopted it from Stephen, in the form that two and two might make five to our present faculties, if external nature were differently constituted. He did not assign it to some remote part of the universe, nor did he call in the activity of some maleficent demon; neither did he say that one and one might make three. He did not explore its implications, or inquire how it might be reconciled with what he had said in other places; but at least he is entitled to a definite statement of what he did say. I confess that I am somewhat puzzled at the different forms in which it has been quoted, and at the irrelevant details which have been added.
[B] Augustus De Morgan (1806-1871), On infinity; and on the sign of equality, Transactions of the Cambridge Philosophical Society 11 Part I (1871), 145-189.
Published separately as a booklet by Cambridge University Press in 1865 (same title; i + 45 pages). The following excerpt is from the version published in 1865.
(footnote 1 on p. 14) We are apt to pronounce that the admirable pre-established harmony which exists between the subjective and objective is a necessary property of mind. It may, or may not, be so. Can we not grant to omnipotence the power to fashion a mind of which the primary counting is by twos, $0,$ $2,$ $4,$ $6,$ &c.; a mind which always finds its first indicative notion in this and that, and only with effort separates this from that. I cannot invent the fundamental forms of language for this mind, and so am obliged to make it contradict its own nature by using our terms. The attempt to think of such things helps towards the habit of distinguishing the subjective and objective.
Note: Those interested in such speculations will also want to look at De Morgan's lengthy footnote on p. 20.
(ADDED 6 YEARS LATER) I recently read Ian Stewart's 2006 book Letters to a Young Mathematician and in this book there is a passage (see below) that I think is worth including here.
(from pp. 30-31) I think human math is more closely linked to our particular physiology, experiences, and psychological preferences than we imagine. It is parochial, not universal. Geometry's points and lines may seem the natural basis for a theory of shape, but they are also the features into which our visual system happens to dissect the world. An alien visual system might find light and shade primary, or motion and stasis, or frequency of vibration. An alien brain might find smell, or embarrassment, but not shape, to be fundamental to its perception of the world. And while discrete numbers like $1,$ $2,$ $3,$ seem universal to us, they trace back to our tendency to assemble similar things, such as sheep, and consider them property: has one of my sheep been stolen? Arithmetic seems to have originated through two things: the timing of the seasons and commerce. But what of the blimp creatures of distant Poseidon, a hypothetical gas giant like Jupiter, whose world is a constant flux of turbulent winds, and who have no sense of individual ownership? Before they could count up to three, whatever they were counting would have blown away on the ammonia breeze. They would, however, have a far better understanding than we do of the math of turbulent fluid flow.
1 + 1 = 2
can be false if you use different axioms,1 + 1 = 2
is not itself an axiom. So using the Peano Axioms (which are usually implied unless otherwise stated),1 + 1 = 2
can only be true since it necessarily follows from the axioms. $\endgroup$