To "take something with a grain of salt" means not to take someone's words too literally. This is because a grain of salt is often insignificant in value, which is an analogy for someone's seemingly insignificant words.