Note that:
If A is a countable infinite set and a is any element in A, then: there's a bijection for A \ {a} and A;
Or, equivalently if A is contained strictly in B, b is in B \ A, A is countably infinite then: there's a bijection for A $\bigcup$ {b} and A;
To prove the second claim, for example: denote A = {an| n is in $N$}, let: b = f(a0), and an = f(an + 1) for n >= 0. then f is a bijection.
(Similar to a previous answer for your question)
If A is uncountable, you can choose a subset in A as A' that is countable, and do a similar thing to add element to A'. (similar proof for removing element from A, by choosing the element you wish to remove in A')
By this, you can add \ remove as many finite element to an infinite set A as possible, and still have a bijection between them. This is a famous question, called "Hilbert's Hotel", to the name of German Mathematician David Hilbert, you can see more on wiki.
(In fact, (1) if A is countably many, you can even add countably infinite elements to A, and there's still a bijection; and sometimes, you can also do this for removing (2) if A is uncountable, you can always do this for both add/remove a coutably many set to/from A)