Is it punishable/treason if I provided a terrorists family with refuge?

that would depend on if you did it knowingly, and whether you provided refuge to the family or the terrorist himself. at the very least, you'd be spending lots of quality time answering FBI questions.