We show that dipole-dipole interactions induced by gravitational force and possibly ion-stream drag force give rise to stable triangular and oriented cubic crystalline structures recently observed in a dusty plasma, as opposed to only unoriented cubic close-packed structures usually expected of Wigner crystals. In certain cases the dipole interaction may flatten the crystal significantly. We calculate the phase diagrams of the crystals and analyze and explain some of their features.