What is the meaning of [He has bigger fish to fry]

He has bigger things to take care of than what we are talking about now