We study temporal correlation of anomalously diffusing particle in a general binding potential. Using the framework of fractional Fokker-Planck equation we obtain a simple analytical expression for the two-time correlation function of the particle displacement often measured in experiments. We obtain a general relation between ergodicity breaking and aging correlation functions and discuss the relation of our theory to such diverse fields as spin-glasses and single molecule experiments in the cell.