This paper investigates the stabilization of underactuated vehicles moving in a three-dimensional vector space. The vehicle's model is established on the matrix Lie group SE(3), which describes the configuration of rigid bodies globally and uniquely. We focus on the kinematic model of the underactuated vehicle, which features an underactuation form that has no sway and heave velocity. To compensate for the lack of these two velocities, we construct additional rotation matrices to generate a motion of rotation coupled with translation. Then, the state feedback is designed with the help of the logarithmic map, and we prove that the proposed control law can exponentially stabilize the underactuated vehicle to the identity group element with an almost global domain of attraction. Later, the presented control strategy is extended to set-point stabilization in the sense that the underactuated vehicle can be stabilized to an arbitrary desired configuration specified in advance. Finally, simulation examples are provided to verify the effectiveness of the stabilization controller.