Is daily more important to understand the factors that influence volumetric changes with increasing age. Although much is known about the general pattern of age effects on brain morphometry, from cross-sectional studies the role of sex in brain aging is still controversial. Aim of this study was test how sex influences the magnitude and direction of age effects on cortical thickness and the volumes of 17 different subcortical brain structures. A total of 1143 healthy participants from seven cross-sectional life-span samples were included in the combined sample. In addition, 96 AD patients were included in a separate sample. All datasets were processed and analyzed with FreeSurfer 4.01. The results from the present study indicate that sex exerts minute and unstable effects on age differences in brain morphometry, both in healthy aging and in AD. Sex did not influence the age slopes of regional cortical thickness, while there was a small effect of sex on the age slope of CSF and pallidum in healthy controls when corrected for Intra-cranial-volume. This fits with the inconsistency of effects seen in previous research.