Of course there's a difference. "Servant" would imply I had a choice in her. Cleaning lady . . . she's an incredibly nosy old woman who wandered into my castle, insisted on staying . . .

And cleans everything.