There are several things that can help scientists evaluate which category something belongs to. The similarity in features is one of them. If two skulls looked alike, they were probably species of the same evolutionary category. For example say humans and monkeys rather than humans and dogs.
Similarly fossils have helped scientists categorise species. Study of the chromosomes (in cases with available chromosomes) can help scientists figure out a lot about the subjects and categorise them.
