In this paper, we discuss about young people's perceptions regarding elderly people and the background of generating processes of their perceptions. A questionnaire survey was conducted on university students in South Korea and Japan, and their impressions regarding elderly people were acquired using the semantic differential (SD) method. In the questionnaire, a living together experience with an elderly person and a caring experience for an elderly person were also confirmed. As a result of applying the two-way analysis of variance (ANOVA) with the factors “living together“ and “caring” experiences to each term used in the SD method, significant differences in interaction were observed in several terms. In addition, in the case of Japan, it was found that many terms in the SD method changed to positive evaluations by adding the “caring” experience to the “living together” experience, whereas there was not much change in South Korea.