Successful traditional settlements refer to a settlement environment that spontaneously built by residents who consider their existing site integrates with excellent social sustainability indicators. This study aims to determine the critical factors of physical character for social sustainability of a traditional settlement with the objective to identify the types of physical characteristics deemed as significant in daily social interaction among the locals. To achieve this, a quantitative method was employed using questionnaire survey distributed to 400 residents in two historic settlements, namely Kampung Pulau Duyong and Kampung Losong located at Kuala Terengganu. Both sites are selected due to good conservation practices observed concerning the physical landscape. The results generated from the Exploratory Factor Analysis (EFA) revealed eleven factors (11) related to social sustainability. Such factors then categorised into six latent factors, which are the preservation of local identity, safety, provision of infrastructure, natural qualities, accessibility, and availability of public spaces. The findings recall the relationship between physical aspects and social sustainability as a step towards improvement in historic site preservation efforts.