If primordial black holes were small enough to decay away in billions of years (i.e., < 200 million metric tons) and made up a significant share of the dark matter, then the galaxies, groups, and clusters would be disintegrating from the loss of binding mass. Since we observe that galaxies and larger structures like clusters remain stable over time, it indicates that this scenario is not happening.
The epoch of recombination occurs when the temperature of the CMB decreases to the temperature at which protons combine with electrons to form neutral hydrogen. Changes in the energy before recombination would not significantly affect this temperature. However, significant radiation from primordial black holes evaporating over time would increase the photon-to-baryons ratio, which probably would have been noticed. This radiation would also create a background spectrum quite separate in form from the microwave background, which is not the case.
Since these effects are not observed, it suggests that primordial black holes, if they exist as a significant component of dark matter, are not small enough to evaporate within the age of the universe.