The 668 fragments were found buried in a plot of land in Thessaloniki, Greece's second largest city, following a 70-year search for the remains of graves smashed when the city's main Jewish cemetery was destroyed.
The head of the city's Jewish community, David Saltiel, said most of the gravestones found dated from the mid-1800s up until World War II.
"This is our history," Saltiel, head of the Central Board of Jewish Communities in Greece, told The Associated Press.
"Apart from the names, the (gravestones) also include the person's occupation. So this is a historic record."
An estimated 60,000 Greek Jews, most of the country's prewar Jewish population, were killed in the Holocaust.
Want to enjoy 'Zen' reading - with no ads and just the article? Subscribe todaySubscribe now