I think it takes some more work to show that the set of all sequences with rational entries and finite non-zero element is countable (denoted $A$).
Because Countable infinitely cartesian product of countable set may not be countable, otherwise we shall be able to prove that $\ell_p(Q)$ is also countable, however, its cardinality is $\mathbb{N}^{\mathbb{N}}=\mathcal{c}$, which is the cardinality of $\mathbb{R}$ and shall be uncountable.
Also, the above set $A$ can not be expressed as a finite product of a countable set. Consider any finite product $\underset{\text{M of Q here}}{\mathbb{Q} \times \mathbb{Q} \times \dots \mathbb{Q}}$, then a rational sequence with (M+1) non-zero entries still has finite support but does not belong to the above product.
Instead, I think we can prove it by constructing a one-to-one mapping from $A$ to $\mathbb{Q}$.
Consider a mapping that encodes the denominator and numerator into decimal spaces separated by 0, e.g. $f((1/3,3/5,\dots,100/101,\dots))=0.10303050\dots10001010\dots$.
Also, in order to take care of the negative entries, instead of using the irreducible fraction $\frac{p}{q}$, we use $\frac{2p}{2q}$ for a negative entry, so e.g. $f((-1/3,3/5,\dots,-100/101,\dots))=0.20603050\dots20002020\dots$.
Since each rational number can be expressed as its irreducible form $\frac{p}{q}$ where $p,q \in \mathbb{N}$ and since each sequence only has finite support, we know the image of $f$ is a subset of $\mathbb{Q}$. Suppose $f(x)=f(y)\Rightarrow 0.p_1^x0q_1^x0p_2^x0q_2^x \dots p_n^x0q_n^x \dots =0.p_1^y0q_1^y0p_2^y0q_2^y \dots p_n^y0q_n^y \dots$, then as there are only finite non-zero digits, we must have $p_i^x=p_i^y$ and $q_i^x = q_i^y$ for all i, hence $x=y$, and we know $f$ is one-to-one.
Since there exists an one-to-one mapping from $A$ to $\mathbb{Q}$, we know $A$ is also countable.