The set of hydrodynamic equations governing a system of cosmic rays, waves and background plasma, is derived. The cosmic rays interact with the background plasma via hydromagnetic waves (e.g., Alfven waves) which in turn are produced by the cosmic ray streaming instability. The convection, diffusion and second order Fermi effect of the cosmic rays are taken into account. A simple example emphasizing the second order Fermi effect is given.