The term speed refers to the size ("magnitude") of the velocity -- that is, how fast the luge is moving, regardless of direction.

The time of one second is standardized. It is the time occupied by 9,192,631,770 vibrations of a specific wavelength of light from a cesium-133 atom.