We need to be very clear and precise, so let me flood you with a bunch of definitions.
If we are talking about "decidable" and "undecidable", we are talking about formal systems.
In a formal system, we have primitive notions (undefined terms and relations/functions among them), axioms, rules of inference, and "grammatical rules" that tell us when a sequence of symbols is a well-formed formula.
A well-formed formula $F$ is provable in the formal system if there is a finite sequence of well-formed formulas such that each term of the sequence is either an axiom, or a consequence of previous formulas in the sequence that follows from the valid rules of inference, and such that the last term of the sequence is $F$.
We say a well-formed formula $F$ is decidable in the formal system if and only if either $F$ is provable, or its negation $\neg F$ is provable. It is undecidable otherwise.
A model of a formal system is a specific interpretation of the primitive terms that makes the axioms true.
A formal system is consistent if and only if it has at least one model.
It is a theorem of first order logic that a well-formed formula $F$ is provable in an axiomatic system if and only if $F$ is true in every model of the system. In particular, $F$ is undecidable if and only if there are models of the system in which $F$ is true, and there are models of the system in which $F$ is false.
Now, notice that while "decidable" and "undecidable" and formal notions: they refer to whether or not a particular formula can be formally deduced from the axiomatic system. By contrast, "true" and "false" are semantic notions: they depend on the meaning (the model) of the terms, and not only on their formal properties (which are given by the axioms and the rules of inference).
In a sense, showing that a formula is undecidable means showing that it is neither true nor false... rather, that it's truth or falsity will depend on the interpretation we give to the terms. A classical example is the Continuum Hypothesis: there does not exist an infinite subset of $\mathbb{R}$ that is not bijectable with either $\mathbb{N}$ or with $\mathbb{R}$. Turns out this is neither true nor false, it is undecidable (assuming Set Theory itself has models): there are models of set theory where it is true, and there are models where it is false. You have one theory in which you can assume it as an axiom, and another theory where you assume its negation as an axiom (in fact, infinitely many theories, one each for what different kinds of such sets there might be).
In a sense, if you already knew whether the conjecture is "true or false" (meaning, true in every model or false in every model), then you've already proven it, it is no longer a conjecture, and it cannot be undecidable. Or else you might be talking about "true in the standard model" (some theories have a 'standard' way of interpreting the terms, such as Peano Arithmetic), or "false in the standard model". In that case, knowing this only tells you that the statement is either provable or formally undecidable. (For example, Goedel proved that there is model of Set Theory in which the Axiom of Choice is true; that showed that it was impossible to disprove the Axiom of Choice, but it did not establish whether the Axiom of Choice was provable or whether it was undecidable; Paul Cohen later showed that there is a model where the Axiom of Choice is false, and that showed that the Axiom of choice was not provable, and so it must be formally undecidable).
For the Millenium Problems, some problems are known to be decidable; others may be undecidable. In some instances, undecidability would establish truth in the standard model. To see an example of this latter situation, think about the Goldbach Conjecture:
Goldbach Conjecture. Every even integer greater than $2$ can be written as a sum of two primes.
Suppose we could show that the Goldbach Conjecture is undecidable in Peano Arithmetic. This would show that it is true in the standard model. Why? Because if there were a counterexample to the Goldbach Conjecture, this could be established in finite time by simply going over all the even numbers and checking all sums of primes smaller than them; this would mean that its falsity in the standard model would be provable, so GC cannot be both undecidable and false-in-the-standard-model. Of course, there are other ways of interpreting the meaning of "number" ("non-standard models") in which GC would be false, but in the standard model it would be true.
The Riemann Hypothesis is one such question: if the Riemann Hypothesis were false, then this could be established by exhibiting a zero and verifying it is a zero (which can be done in finite time). So if the Riemann Hypothesis is formally undecidable, then it must be true in the standard model.
I have no idea what you are going on about with "infinity number of cases"...