Protein glycosylation is a common post-translational modification on extracellular proteins. The conformational dynamics of several glycoproteins have been characterized by hydrogen/deuterium exchange mass spectrometry (HDX-MS). However, it is, in most cases, not possible to extract information about glycan conformation and dynamics due to the general difficulty of separating the deuterium content of the glycan from that of the peptide (in particular, for O-linked glycans). Here, we investigate whether the fragmentation of protonated glycopeptides by collision-induced dissociation (CID) can be used to determine the solution-specific deuterium content of the glycan. Central to this concept is that glycopeptides can undergo a facile loss of glycans upon CID, thereby allowing for the determination of their masses. However, an essential prerequisite is that hydrogen and deuterium (H/D) scrambling can be kept in check. Therefore, we have measured the degree of scrambling upon glycosidic bond cleavage in glycopeptides that differ in the conformational flexibility of their backbone and glycosylation pattern. Our results show that complete scrambling precedes the glycosidic bond cleavage in normal glycopeptides derived from a glycoprotein; i.e., all labile hydrogens have undergone positional randomization prior to loss of the glycan. In contrast, the glycosidic bond cleavage occurs without any scrambling in the glycopeptide antibiotic vancomycin, reflecting that the glycan cannot interact with the peptide moiety due to a conformationally restricted backbone as revealed by molecular dynamics simulations. Scrambling is also inhibited, albeit to a lesser degree, in the conformationally restricted glycopeptides ristocetin and its pseudoaglycone, demonstrating that scrambling depends on an intricate interplay between the flexibility and proximity of the glycan and the peptide backbone.