An object is in a vertical position when it is aligned in an "up-down" direction, perpendicular to the horizon.

Compare horizontal.