We propose a scheme for realizing a controlled geometric phase gate for two neutral atoms.We apply thestimulated Raman adiabatic passage to transfer atoms from their ground states into Rydberg excited states, and use theRydberg interaction induced energy shifts to generate geometric phase and construct quantum gates.