# Why does “convex function” mean “concave *up*”?

A function $f : \mathbb{R} \to \mathbb{R}$ is convex (or "concave up") provided that for all $x,y \in \mathbb{R}$ and $t \in [0,1]$, $$f(tx + (1-t)y) \le tf(x) + (1-t)f(y).$$ Equivalently, a line segment between two points on the graph lies above the graph, the region above the graph is convex, etc. I want to know why the word "convex" goes with the inequality in this direction, and how I can remember it. Every reason I have heard makes just as much sense applied to the opposite inequality ("concave down").

-
I just memorize $x^2$ is convex. :) –  KennyTM Aug 26 '10 at 18:02
this post should be "community wiki" (if not closed), I believe –  Grigory M Aug 26 '10 at 18:32
I haven't finished reading this yet so I can't say for sure, but you might find an answer here: terrytao.wordpress.com/2009/01/09/245b-notes-3-lp-spaces –  isomorphismes Dec 18 '10 at 8:34
Why is there a vote to close this question? –  t.b. Aug 16 '11 at 16:19
You are compromising the utility of the notion by failing to relativize it to subintervals of the domain. About 80% of the time what you are interested in in Calc 1 regarding concavity is where the the sign of the concavity (equivalently, the sign of the curvature) changes, ie, in any INFLECTION POINTS. –  Mike Jones Sep 29 '11 at 21:25

Not sure why convex is defined that way, but one way to remember is that the derivative is monotonically increasing for some convex functions.

Or maybe just remember that $e^x$ is conv$e^x$. (I just thought of this one!)

-
Mnemonics don't explain the "why". –  isomorphismes Dec 12 '10 at 3:49
@Lao: Did you even read the question? The questions clearly asks why and how to remember it. Did you even read the first sentence of this answer, where it states that this answer does not answer the why...? –  Aryabhata Dec 12 '10 at 4:32
Sorry, you're right. I thought the OP wanted not a mnemonic to remember it, but a justification / reason to remember it by. –  isomorphismes Dec 12 '10 at 9:14

Lets say that you accept the definition of a convex set in higher dimensions, like a sphere in $\mathbb{R}^3$. The question I seek to provide insight into is why convex functions in one variable are defined as opening up instead of down, since this seems like an arbitrary definition. This is because, depending on how you look at the graph, you could naively view the function as bending outwards (like a convex set) or inwards (concave). However, there is a nice connection between these two things using metric spaces that I think can provide some meaning to the way it is defined.

Most of the metrics that you are familiar with have open balls that are convex, such as the standard metric. But some are actually non convex. A good example of this is $d(x,y) = \sum \sqrt{|x_i - y_i |}$. (note that $\sqrt{x}$ is not a convex function)

Here is an interesting condition:

Given a metric $d$. If for all $y,z\in E$ and $0\leq t\leq 1$,

$d \left(x, \ t y \; \, + \; (1-t) z \right) \quad \leq \quad t d(x,y) \; + \; (1-t) d(x,z)$

then the open balls formed by $d$ are convex. [1] In other words, if you fix $x$ and $d(y):\mathbb{R}^n\rightarrow \mathbb{R}$ is a convex function, then the open balls are convex sets.

Usually $d(x,y) = \sum f \, (x_i,y_i)$, for some $f:\mathbb{R}^2\rightarrow\mathbb{R}$. If we fix $x$ and $f:\mathbb{R}\rightarrow \mathbb{R}$ fits the definition of a convex function, then $d$ will also be convex, and the condition will be satisfied, giving us convex balls.

So convex functions (if they can form a metric) will give you convex open balls. A nice connection that makes the definition make more sense. Other conditions that guarantee convex open balls are discussed in the paper I reference.

[1] Norfolk, T. (1991). When does a metric generate convex balls? www.math.uakron.edu/~norfolk/convex.ps

-
"I think you would agree that a sphere or any other convex shape fits your intuitive idea of what "convex"" Is this not circular? My intuition about what 'convex' is supposed to mean may be shaped by having seen the definition of convexity and by associating the definition to several known shapes. –  user116 Sep 1 '10 at 16:50
@Srikant: "Convex" does have a standard meaning in English. To strengthen his point, GottfriedLeibniz might also appeal to the widespread consistent use of "convex" in many branches of mathematics. In effect, this views the question as probing for connections between an idea in one area of mathematics (single variable calculus) and possibly related ideas. –  whuber Sep 1 '10 at 17:00
@Srikant yes, in essence its a circular statement. It wasn't really how I meant to word it. I will edit it. My point is, like @whuber mentions, that the definition of convex functions in one variable are defined as opening upwards instead of downwards seems arbitrary. My answer is meant to show that the definition in one variable is consistent (in a way) with the definition of a convex shape in higher dimensions. Intuitive is probably the wrong word. In fact, I tend to loath using the word "intuitive" because its meaning is so damn ambiguous. –  AnonymousCoward Sep 1 '10 at 18:32
I should add that any function $f:\mathbb{R}^n\rightarrow\mathbb{R}$ is defined as convex if its epigraph is a convex set. I dont think that has been mentioned here. –  AnonymousCoward Sep 1 '10 at 18:52
@GottfriedLeibniz: I'm aware of that, but why the epigraph and not the hypograph? –  Nate Eldredge Sep 1 '10 at 21:30

One of my professors told me the following memorable line: "A concave function looks like the roof of a cave." which helps me remember what is a concave and what is a convex function.

-
+1: Nice way to remember :-) –  Aryabhata Aug 26 '10 at 18:01
Yes, it's a great mnemonic, but does it really answer the question, which asks why? –  whuber Sep 1 '10 at 15:43
@whuber It does in part because the OP also asked 'how I can remember it'. –  user116 Sep 1 '10 at 16:26
@Srikant: agreed, but that seems like the less significant part of the question to me. Mnemonics are extremely useful, whence their popularity, but in general they do nothing to help one's understanding. Answers like that of GottfriedLeibniz are much deeper and satisfying, even if (in some opinions) they might turn out to be incomplete or even wrong. –  whuber Sep 1 '10 at 16:58
@whuber I am not disputing your point about the 'why'. Whether it really answers the question is upto the OP to decide. I simply answered that part of the question where I thought I could contribute something. –  user116 Sep 1 '10 at 18:32
show 1 more comment

The primary concept is convexity, not concavity. It applies to geometric figures, originally lenses, and this usage was adapted to functions. There is no comparable concept of concavity for, say, 2-dimensional regions, except as the absence of the property of convexity. There is also no property for figures in general corresponding to the anti-convexity inequality, because most non-convex figures will be locally convex. It is a matter of historical convention that a function is called "convex" if the region above the graph of the function is convex, and it would have caused no mathematical problem to use the opposite convention based on the region below, but concavity is a more limited concept that is defined in terms of convexity (or only defined for functions) and not the other way around.

The terms "concave up" and "concave down" appear mainly in non-specialist US college textbooks on calculus. They are nonstandard terminology and, I think, bad practice that should be discouraged (with luck and sufficient ruthlessness maybe they can be squelched in a generation...). As far as I know the etymology went as follows:

1. Like "convex", the word "concave" has a prior use in optics. Concave (inward-curved) lenses are the opposite of convex lenses, so there is a pre-existing word for "not convex" or "convex in the opposite direction".

2. Convex has an absolutely entrenched mathematical use to denote convex figures as well as functions (and sequences) with increasing derivative.

3. Functions whose negative is convex occur frequently and "concave [function]" came into use as a convenient description of this situation. The linguistic logic was clear enough to make this immediately understandable. It's not clear whether it was more or less favored compared to statements involving the negative, such as saying that $-f(u)$ is convex, or $f$ is anti-convex, or that is it the negative of a convex function. I don't have data at hand from web searches or anything like that, but I think concavity is less common as a description of negatively convex sequences. For functions the ability to draw a graph makes the resemblance to lenses clearer so that both words seem sensible. (added: concavity as a counterpart to convexity for functions and sequences also gained momentum as its own term once log-convexity and log-convex became standard usage. Because the relationship between log-convex and log-concave functions is not simply change of sign but a multiplicative inverse, using only the words based on convexity might lead to confusion or circumlocution.)

4. Authors of US college calculus textbooks, writing for an audience not familiar with or necessarily interested in convex figures and optics, and aware of potential for confusion (e.g., the graph of a concave function still bounds a convex-shaped region, or the subsequent use of convex to describe functions of several variables and the regions on which those are defined) cooked up a terminology based on "concavity" as a stand-alone concept, limited to the one-variable context where $f(x)$ is graphed with the $y$-axis direction being upward. It's not clear how consistent this concave-up and concave-down terminology is between books and whether it agrees with the earlier, non-confusing use of concave to denote negative convexity.

-
What's so bad about "concave up" and "concave down" in Calc 1? I've never had a student mix up which is which. That's surely more important than purity. –  isomorphismes Dec 13 '10 at 1:05
Do you have a source on that etymology? –  isomorphismes Dec 13 '10 at 1:06
"with luck and sufficient ruthlessness maybe they can be squelched in a generation..." - I gave a +1 solely because of this statement... :D –  Ｊ. Ｍ. Dec 13 '10 at 5:18
@Lao: one bad thing is that a convex function is "concave down" (according to wikipedia's article en.wikipedia.org/wiki/Convex_function), while also being the opposite of a concave function. Adding new terminology inconsistent with older, more general, useful, established and immovably entrenched terminology is a step backward. There is nothing you can express with "concave up/down" that cannot be expressed as easily with "convex", and latter term has the advantage of carrying additional associations that can be used to reinforce the meaning. –  T.. Dec 13 '10 at 5:38
@T..: It looks like you misread the Wikipedia article. The relevant portion is: " a real-valued function f(x) defined on an interval is called convex (or convex downward or concave upward" –  Mike Jones Sep 29 '11 at 19:49

A line is said to "support" the graph of a function (or indeed, any subset of the Cartesian plane) if it "holds up" the graph: that is, the graph lies entirely above or on the line. (After all, gravity pulls downward!) We might think of the union of all support lines as the "ground" on which the graph lies; everything else--its set-theoretic complement--is the "sky".

A function of the real numbers is convex if and only if its graph is the boundary between the ground and the sky. This is a special case of the more general idea of convexity that applies to arbitrary planar regions, the same as the familiar distinction between a convex and non-convex polygon, for example. For arbitrary regions there is no definite "up" and "down" anymore, though, so we say that a line supports a region when the region lies entirely within one of the two closed half-planes bounded by that line. (Thus, the interior and boundary of a convex polygon form its "sky" and everything outside is the "ground.")

In short, calling a "concave upward" function "convex" unites two closely related familiar concepts and is justified by the universal earthbound human experience that gravity usually pulls downward.

-
This is a nice answer but is gravity really a necessary part of the explanation? It doesn't sound like it to me. –  isomorphismes Dec 12 '10 at 4:10
@Lao Tzu Given that this is psychology, not mathematics, there is something to be gained by appealing to innate human sensory processing skills. These include a strong up-down orientation and a highly refined ability to detect horizons (level, linear features). Both play a role in our conventions for graphing and describing functions. So gravity is not necessary but it is informative. –  whuber Dec 12 '10 at 16:35

With the caveat that it's usually more helpful to devise your own mnemonics than follow someone else's

• here are a couple of mine, poorly drawn (the second is same as Srikant Vadali's answer):

• convex: smiley face

• Another way of remembering them, if you recall the meanings of convex and concave outside mathematics (as in lenses, etc.), is that you look from below: if the graph of the function viewed from below looks convex (i.e., bulging towards you) the function is convex, if it looks concave the function is concave.

• Yet another way is to keep in mind the definition: "a function is convex if its epigraph is a convex set". The epigraph is the set of points lying above the graph, and a convex set is one in which every line segment between two points in the set lies within the set. [Actually, for me, this definition is more useful for remembering what epigraph means :-)]

-
"Epi" means "above." –  whuber Sep 1 '10 at 17:01
So why shouldn't a convex function be one whose hypograph is convex? –  Nate Eldredge Sep 1 '10 at 21:31
@Nate: I was answering the “how I can remember it” part of your question, not “why the word "convex" goes with the inequality in this direction”. Of the five mnemonics I gave in the answer for remembering what "convex" means, the last is clearly the poorest, since it essentially requires you to memorize a definition. So what? :-) –  ShreevatsaR Sep 3 '10 at 22:09
A problem with using the 'v' in convex is that concave also has a 'v'. It thus reduces to con$\textbf{cave}$ and the other one. –  Jonas Meyer Oct 5 '13 at 5:39

Instead of thinking about the graph of $f: \mathbb{R} \to \mathbb{R}$ as a 2-D object in the plane, think about $f$ mapping one number line onto another.

I'll return to that picture, just notice that there is plenty of "room" so to speak and that the arrows mapping point to image will never "fall back" on each other, overlap, or "crowd in" so long as the function is convex.

Imagine a closed loop in the plane whose interior is non-convex. It's like a deflated balloon. You need to "blow it up" until it's at least modestly ($\leq$) full of air for the interior to be convex. Similarly if you had a non-convex polygon and "blew air" inside of it, you would get a convex shape. So it's like convex shapes have to be sufficiently "inflated".

Similarly, the arrows in an $\mathbb{R} \to \mathbb{R}$-type picture like the above would be "flopping" inward onto each other, deflated if you will. In the convex mapping the arrows don't overlap at all -- they've got "pressure" or "energy" pushing them outward enough so that they don't overlap. So the image is properly inflated, if you will.

So @NateEldridge, the epigraph being a convex set is a red herring. Think about just the right-most point of a graph as it's being generated by a s-l-o-w graphing calculator. The image has to "outrun" the domain it comes from by $\geq$ each $dt$. And there you have your $f(\mathrm{interior\ of\ domain}) \leq \mathrm{image}_1 + \mathrm{image}_2$.

This is meant as an elaboration on @whuber's answer.

-
Can you make this a little more precise? I'm having trouble seeing how your interpretation applies to the function $f(x) = x^2$, which is convex, but whose arrows do "overlap" and "crowd in" around 0, unless I'm misunderstanding what you mean by those words. –  Rahul Dec 12 '10 at 12:36
You may have found an error in my explanation. Or maybe I need to add an "inverse interpretation" for $|\mathrm{input}|<1$. I do still believe that the $\mathbb{R}^2$-ish picture is a red herring, though. –  isomorphismes Dec 13 '10 at 1:02
Maybe I can steal from @T.. and say that "strictly increasing derivatives" corresponds to "blowing up the balloon" whereas derivatives that "lack the internal pressure" are "deflated" like the loop or balloon above. –  isomorphismes Dec 13 '10 at 1:10
Maybe a better way to say the above would have been to use the words "nonnegative curvature" $\leftrightarrow$ convex set, and "negative curvature" $\leftrightarrow$ non-convex. –  isomorphismes Mar 18 '11 at 10:57