The learner differences and contrasts between the two cultures involved are important aspects that influence foreign language teaching and learning. The foreign teacher as an outsider of the learner's native culture, inevitably faces quite a few challenges. With the focus on the self-esteem, character types, and motivation of the learner, the paper analyses how these factors influence the foreign teacher's teaching. Relevant solutions are also proposed.