There are infinitely many different theories stronger than Presburger arithmetic and weaker than Peano arithmetic. The classic examples of theories weaker than Peano arithmetic are determined by adding different amounts of induction to Robinson arithmetic.
The $\Sigma^0_n$ induction axioms say that any set of numbers definable by a $\Sigma^0_n$ formula that contains 0 and is closed under successor contains every natural number.
The $\Sigma^0_n$ bounding axioms say that any there is no $\Sigma^0_n$ definable function on a bounded initial segment of the natural numbers with an unbounded range.
The theory Q of "Robinson arithmetic" consists of a small number of axioms about the arithmetical operations.
The theory I$\Sigma^0_n$ is Q plus the $\Sigma^0_n$ induction axioms.
The theory B$\Sigma^0_n$ is Q plus the $\Sigma^0_n$ bounding axioms.
It is known that, for each $n$, I$\Sigma^0_{n+1}$ implies B$\Sigma^0_{n+1}$, which in turn implies I$\Sigma^0_n$, and the implications are all strict.
None of these theories is decidable, nor is any other consistent extension of Robinson arithmetic. The first incompleteness theorem applies to all these theories.
The standard proof of the second incompleteness theorem applies to all the theories I$\Sigma^0_1$ and stronger. The second incompleteness theorem can be proved for some weaker systems as well, but things get very technical for systems weaker than I$\Sigma^0_1$.