While the other answers (and comments) implicitly address the question stated in the title of the OP, I thought it may be useful to include an explicit answer, as well.
Does the “field” over which a vector space is defined have to be a Field?
Yes, a vector space is defined over a field; i.e. if the scalars do not refer to a field, the resulting object is not by definition a vector space.
For completeness: as pointed out in the other answers and comments, there are objects with analogous definitions, in the case that the scalars belong to a ring (as in the example provided in the OP), and the other axioms are met, the resulting object is called a "module." As the subsection on modules on the Wikipedia vector space page says (emphasis added):
Modules are to rings what vector spaces are to fields: the same axioms, applied to a ring R instead of a field F, yield modules. The theory of modules, compared to that of vector spaces, is complicated by the presence of ring elements that do not have multiplicative inverses. For example, modules need not have bases, as the Z-module (that is, abelian group) Z/2Z shows; those modules that do (including all vector spaces) are known as free modules. Nevertheless, a vector space can be compactly defined as a module over a ring which is a field, with the elements being called vectors. Some authors use the term vector space to mean modules over a division ring.[105] The algebro-geometric interpretation of commutative rings via their spectrum allows the development of concepts such as locally free modules, the algebraic counterpart to vector bundles.