If a character starts as a class with Stealth, and later changes to a class without Stealth, does the character still get the benefits of the Stealth skill?

Follow up, does this apply to other skills like, say, Picking Locks or the spell casting skills?

yes, it does.

He will still get the AC improvement for the current stealth level, but he won't be able to improve stealt anymore.