Hunters are a sort of two-fold challenge; combat and puzzle. The masks are a guaranteed drop from killing them - akin to a gunplay challenge. But the Ivory Keys are rewards from solving their puzzles in the process. Some Hunters can be, in essence, brute-forced and killed without solving their puzzle, giving a mask but no key.