In statistics, a probability distribution is any function, $f(x)$ which is never negative (probability is either 0 or positive) and it sums up to 1 (100%). Mathematically we'd express this as:
\[\begin{align*}
\forall x f(x)\ge 0 \\
\sum_x f(x) = 1
\end{align*}\]
In the case of a continuous random variable, the second formula would be expressed as an integral:
$$\int_x f(x)dx = 1$$
There are some differences between discrete and continuous random variables but the ideas behind them are the same.
To motivate the idea behind an expected value, we'll begin with a more familiar concept: an average.