Literally, a leaning toward (or away from) some specific orientation. In this context, “orientation” is should be interpreted as being relative to “truth”. Being biased is the opposite of being impartial, or neutral.
The term originates with reference to fabric that is cut at some angle to the weave.