I'm not a native English speaker. A quick Google search revealed the symbol's name is apostrophe, just like in French. When used in a mathematical setting, I usually call it prime, so for instance $f'$ I'll read $f$ prime. That's the way you call it in French, but I just realized I didn't actually know whether that was the way you call it.
Thank you!