Could be this ^^, and, yes, generally, there is / are some other source(s) of variation in your data that is / are much greater than the expected source.
You can check for statistically significant correlations between your PCs and your metadata via: Correlate the principal components back to the clinical data
Without actually seeing your data, there's not much else that we can say.