Tennenbaum's theorem proves neither addition nor multiplication can be recursive in any countable non-standard model of arithmetic. Tennenbaum's proof applies to theories much weaker than PA.
Tennenbaum's proof is a proof by contradiction. If addition or multiplication is recursive in a non-standard model then it is possible to use a form of induction called overspill to prove recursively inseparable sets can be encoded as non-standard natural numbers. Overspill says if $f(n)$ is true for all standard natural numbers then $f(\alpha)$ is true for some non-standard natural number, $\alpha$. An example of a recursively inseparable set would be the set of standard natural numbers encoding a Turing machine that halts on blank input.
Let $\mathbb{N}^*$ be a countable non-standard model of PA and let $\mathbb{Z}^*$ be the integers extended from $\mathbb{N}^*$. A "non-standard finite field" would be a ring $\mathbb{Z}^* /p^* \mathbb{Z}^*$ where $p^*$ is a non-standard prime number larger than any standard natural number. Non-standard finite fields admit almost quantifier elimination. This means non-standard finite fields must be "almost recursive".
It can be shown Tennenbaum's theorem applies to non-standard finite fields. If there exists a recursive non-standard finite field then Tennenbaum's proof by contradiction becomes a proof of contradiction. It means we can recursively determine if a standard natural number, $n$, encodes a halting TM by checking if $n$ is a root of one of a finite set of polynomials.
Is "almost quantifier elimination" enough to prove a non-standard finite field is recursive? Even if it is not, this seems to be a big problem. James Ax proved the theory of finite fields is decidable. Can there be a recursive mapping from a recursive model of finite fields to a non-recursive model or could we once again derive a contradiction?