“Gaff” is an informal word for “home.”

Although the origins of this phrase are largely unknown, a gaff in the 18th-century was a music hall or theatre, and so it’s believed to derive from this.

“What are you up to this weekend? We’ve got a party at our gaff, if you fancy it?”