Simply as the title says. I've done some research, but still haven't arrived at an answer I am satisfied with. I know the answer varies in different fields, but in general, why would someone study linear algebra?
- Anybody can ask a question
- Anybody can answer
- The best answers are voted up and rise to the top
Linear algebra is vital in multiple areas of science in general. Because linear equations are so easy to solve, practically every area of modern science contains models where equations are approximated by linear equations (using Taylor expansion arguments) and solving for the system helps the theory develop. Beginning to make a list wouldn't even be relevant ; you and I have no idea how people abuse of the power of linear algebra to approximate solutions to equations. Since in most cases, solving equations is a synonym of solving a practical problem, this can be VERY useful. Just for this reason, linear algebra has a reason to exist, and it is enough reason for any scientific to know linear algebra.
More specifically, in mathematics, linear algebra has, of course, its use in abstract algebra ; vector spaces arise in many different areas of algebra such as group theory, ring theory, module theory, representation theory, Galois theory, and much more. Understanding the tools of linear algebra gives one the ability to understand those theories better, and some theorems of linear algebra require also an understanding of those theories ; they are linked in many different intrinsic ways.
Outside of algebra, a big part of analysis, called functional analysis, is actually the infinite-dimensional version of linear algebra. In infinite dimension, most of the finite-dimension theorems break down in a very interesting way ; some of our intuition is preserved, but most of it breaks down. Of course, none of the algebraic intuition goes away, but most of the analytic part does ; closed balls are never compact, norms are not always equivalent, and the structure of the space changes a lot depending on the norm you use. Hence even for someone studying analysis, understanding linear algebra is vital.
In other words, if you wanna start thinking, learn how to think straight (linear) first. =)
Hope that helps,
Having studied Engineering, I can tell you that Linear Algebra is fundamental and an extremely powerful tool in every single discipline of Engineering.
If you are reading this and considering learning linear algebra then I will first issue you with a warning: Linear algebra is mighty stuff. You should be both manically excited and scared by the awesome power it will give you!!!!!!
In the abstract, it allows you to manipulate and understand whole systems of equations with huge numbers of dimensions/variables on paper without any fuss, and solve them computationally. Here are some of the real-world relationships that are governed by linear equations and some of its applications:
Arbitrarily large problems of the types listed above can be converted into simple matrix equations, and most of those equations are of the form
Linear algebra is so powerful that it also deals with small deviations in lots of non-linear systems! A typical engineering way to deal with a non-linear system might be to linearize it, then use Linear Algebra to understand it!
Linear algebra is your ticket to multidimensional space. Study it if you are into economics, computer graphics, physics, chemistry, statistics or anything quantitative (in today's world, that's everything).
Meaning of "Linear" and why it is "Easy"
Since you are asking the question, perhaps you would benefit from a discussion of what "linear" means, and why it is "easy", as mentioned in some answers above.
The word "linear" is to be understood as in a linear function (a line) in calculus, such as
You will know that in calculus, the Taylor expansion of a function
If you use only the first two terms of the Taylor expansion of
If you set
you can see that this is a linear function just like
If you want to do slightly better, use the first two terms of the Taylor expansion of
How Linear Algebra Comes In
Now what do we do if we have a function that depends on several variables (or, which is the same, a variable x that is a vector containing these variables as components)? This is called multivariate calculus (because, multiple variables).
In that case,
As you have seen, the linear and quadratic approximations are the easiest ways to think about complicated functions
Linear algebra deals with vectors, matrices, and tensors, and how to operate them with each other so that everything makes sense and is useful.
In other words, linear algebra is your ticket to multidimensional space, such as the three-dimensional space we inhabit (e.g. computer graphics, physics) or the space of many variables a function depends on (economics, more physics).
Economics example: Price (our function
For the mathematician
Linear algebra is of course a rich field in its own right but I wanted to write a motivating explanation to aspiring students who do not yet know what it is and how it is relevant to their lives.
Patrick Da Silva gives a good answer, however I will expand. Well worth looking at his post when (or if) you do get into Linear Algebra and come back to this post a year later or so with some knowledge under your belt, as you can easily extend your studies for a couple of years by what he stated.
Your beginning motivation to study linear algebra is to put together what you initially learn in (mathematically) geometry and calculus and in (education) high school, college, or even first year or second year of university.
Imagine there's some "room" where everything you played around with in A-Levels or high-school was contained; $\sin(x), \cos(x), ln(x)$ were there, a definition of a field and some set theory.
Now suppose we want to understand this room. Suppose instead of looking at each little "person" in the room, we know that if they are in that room, they behave under a specific way.
Linear Algebra (and Algebra in general) allows us to classify and understand many objects, situations, spaces, to some basic context. At the a high undergraduate level, a remarkable theorem in Hilbert Spaces allows you to identify any separable Hilbert space to some specific, well-known Hilbert Space. This is just the work of the last paragraph in application.
Therefore, if you want structure, you need algebra. Linear algebra specifically so you can understand the basic structure.
One application of Linear Algebra is in the use of eigenvalues.
We can understand some specific systems; weather predictions, behaviour of people, game situations, etc, and the long run behaviour (as it approaches $\infty$ so as to speak) by instead of looking at some function $f(x)$, we look at some real value $\lambda$ such that $f(x)=\lambda x$ at some meaningful $\lambda$.
Linear Algebra allows us to start understanding basic linear systems with use of matrices and vectors.
Lastly, for a purely computational reason, Linear Algebra gives you many tools for proving many key theorems. The infinite dimensional Pythagorean theorem, Cauchy-Schwarz inequality, Bessel Inequality, etc, are frequently used in many areas of mathematics to prove key theorems. This is good motivation for any subject.
I am pretty sure a solution to a system of linear equations and their representations as matrices is part of linear algebra. These kind of systems are used in just about every discipline. Also, things like vectors are...just too ubiquitous for me to articulate. The field of linear algebra is just the ground work of almost everything in science and higher math.
Linear Programming is also a term that i want to throw in. Many problems (no list here) can be expressed as a linear optimization problem. Being able to solve those efficiently means being able to solve an incredible amount of real-world problems . Although in some cases, there exist more efficient ways to solve a specific problem, the linear program and the theory behind it often gives rise to new ways to approach a problem.
Does linear optimizaion still count as Linear Algebra?
Personally I found that Linear Algebra is very sound - in particular compared to Calculus - and fun to study. Its soundness gives it a certain beauty :-)
In addition to the good points already made, one function of the linear course at many schools is that this is often the first place where serious attention is paid to reading and constructing rigorous proofs at a level beyond the all-too-common "handwaving" pseudo-proofs that appear in some calculus courses. As a result, at such places a linear algebra course can also provide a way for students to assess whether or not mathematics is going to be a good fit for them. Whether it is or isn't, most students come out of the course with a solid start towards mathematical maturity.
Because it's fun!
Linear algebra is stuff you see around every day: electricity, economics, they way your car handles.
Since most people never get to see this, it also gives you a view of the world that most people don't see. That adds an interesting human dimension to the knowledge.
Taking my examples, you understand why the un-sprung weight of your car is important? What would Marx think about adding friction to high-frequency trading? Why is your electricity supply AC instead of DC?
Right now, I am sitting at my desk at a aerospace company and due to the fact that no one solve the Navier-Stokes equations so far, our cluster is doing its best to solve all the liner systems which are results from our computation. Linear algebra is in my opinion the most important part of math in applied industry. Everything comes down to $Ax=b$, so you better pay attention when you're taught how to solve them ;)
When you learn ODE, solve some surface integral,do the circuit analysis or numerical analysis,systems control or so you will find it is useful. You will only find the true value of it when it's the time you relly need it.If you do not tend to a field links to engineering or math,it may not have vaule.It may like the ancient style prose, when you come to a situation like the ancient says you will find what they have said is ture and moral-philosophical.
Good question. I didn't understand Linear Algebra for a while.
In other areas of math - Calculus, Trigonometry, etc. - you learn complicated functions of one variable. $f(x) = x^4 + 5x^2 + 15$ Yes, you occasionally get equations with multiple variables, but that is never the goal. In Linear Algebra, you get simple functions with many variables. That's the key: simple functions of many variables.
Now, simple functions are boring. A huge piece of the study of Linear Algebra is figuring out how to use the complex functions with many variables. (I wish there was a good engineering textbook that presented this clearly!) One way is to apply the complex functions to the data before putting it into linear algebra. (This is done when curve-fitting data.) Another is to use partial derivatives to do a linear approximation of a complex function near a particular point in space. (Useful in physics.) Lastly, if you understand properties the matrices and the complex function, you can sometimes combine them directly. (E.g., applying the Taylor series expansion to the eigendecomposition.)
So, Linear Algebra is useful any time you have multiple variables. It's useful when you have many moving parts in an engine, concentrations of multiple chemicals in a test tube, many regions of atmosphere in a climate simulation, prices of stocks in a market, etc.. Even though some of those are non-linear systems, there are techniques that may make Linear Algebra useful.
POST SCRIPT: Linear Algebra textbooks are, in general, awful. They apply transpose to vectors. They focus on calculation rather than use. (E.g., how to compute a determinant.) They focus on irrelevant topics. (E.g., determinants.) Some adequate ones are by Axler and by Hoffman & Kunze, but both of those are for mathematician, not engineers.