Occam's razor (or Ockham's razor) is a principle from philosophy. Suppose there exist two explanations for an occurrence. In this case the one that requires the smallest number of assumptions is usually correct. Another way of saying it is that the more assumptions you have to make, the more unlikely an explanation. Occam's razor applies especially in the philosophy of science, but also more generally.
William of Ockham, a Franciscan friar who studied logic in the 14th century, first made this principle well known. In Latin it is sometimes called lex parsimoniae, or "the law of briefness". William of Ockham supposedly wrote it in Latin:
This translates roughly: More things should not be used than are necessary.
This means if there are several possible ways something might have happened, the way which uses the fewest guesses is probably the correct one. However, Occam's razor only applies when the simple explanation and complex explanation both work equally well. If a more complex explanation does a better job than a simpler one, then you should use the complex explanation.
A problem with Occam's razor is that the sentence is not really about things, but about explanations or hypotheses. Other thinkers have come up with other versions:
"We consider it a good principle to explain the phenomena by the simplest hypothesis possible". Ptolemy. Not only is Ptolemy earlier than Occam, but Occam's supposed wording cannot be found in any of his existing works.
"We are to admit no more causes of natural things other than such as are both true and sufficient to explain their appearances. Therefore, to the same natural effects we must, so far as possible, assign the same causes". Isaac Newton.
"Whenever possible, substitute constructions out of known entities for inferences to unknown entities". Bertrand Russell.
In science, Occam's razor is used as a heuristic (general guiding rule or an observation) to guide scientists.
Example: Two trees have fallen down during a windy night. Think about these two possible explanations:
The wind has blown them down.
Two meteorites have each taken one tree down and, after striking the trees, hit each other removing any trace of themselves.
Even though both are possible, several other unlikely things would also need to happen for the meteorites to have knocked the trees down, for example: they would have to hit each other and not leave any marks. In addition, meteorites are fairly rare. Since this second explanation needs several assumptions to all be true, it is probably the wrong answer. Occam's razor tells us the wind blew the trees down, because this is the simplest answer therefore probably the right one.
Example: A person is standing on the top of a roof and dropping a feather. In calculating how long it takes for the feather to reach the ground, to make the maths simpler, one might make an assumption: that the effect of air resistance can be ignored. This assumption makes the problem simpler, but is unlikely to lead to a good prediction as to the time it will take for the feather to fall. Thus, making the assumption that air resistance can be ignored is in this case not the "simplest" in concept, but the simplest in other respects (in this case, the maths). Not making the assumption here is the "simplest" in concept because it involves making fewer assumptions.
Occam's razor also comes up in medicine. When there are many explanations for symptoms, the simplest diagnosis is the one to test first. If a child has a runny nose, it probably has the common cold rather than a rare birth defect. Medical students are often told, "When you hear hoof beats, think horses, not zebras".