Disappear without trace.

Shakespeare came close to this phrase in Othello, 1604:

Clown:
Then put up your pipes in your bag, for I’ll away. Go; vanish into air; away!