What does ‘pull your chain’ mean?

( vp ) To annoy, bother. Boyd has been awfully quiet lately; let’s pull his chain and ask how he is doing with that girl who just left him.