A vector is an entity that has both a value and a direction. Examples of vectors in the real world and physics based games include speed, acceleration and momentum. Properties that have only values but no direction are called scalars and include location, mass, density and so forth.
Vectors are needed for games that emulate physical properties that are vector like (as mentioned - speed, acceleration and so forth). The mathematics that are used for vector calculations are called linear algebra.