Using the concept of isoclinism, we study closely the center of the group Autc(G) of central automorphisms for a certain class of finite p-groups G.We also give some necessary and sufficient conditions on a finite purely non-abelian p-group G of class 2 (p odd) for the group Autc(G) to be elementary abelian.