What is the meaning of [poor as a church mouse]

When we got married, we were both poor as a church mouse (very poor) and we had to live with my husband’s parents.