In the book of Linear Algebra by Werner Greub, at page 87 section 3.7, it says that
If a corresponding homogeneous system of an inhomogeneous system possesses only the trivial solution, the inhomogeneous system has a solution for every LHS, i.e the $B$ matrix in $Ax=B$.If the homogeneous system has non-trivial solutions, then the inhomogeneous one is not solvable for every choice of $B$, and if it is solvable, it has infinitely many solutions.
But how can the inhomogeneous have infinitely many solutions, if it is solvable, I could't understand.