Destroy Computer????

when people have illigal files on their computer that could get them aressted, whay do people always tell them to destroy the computer? couldent they just destroy the hard drive and then replace it with a new hard drive? Wouldent that just destroy the files? Is there a problem with this?? (Don't worry i am just curiouse i don't have any illigal files)