The Iranian Jewish community in the U.S. has declined an official invitation to meet with Iranian President Hassan Rohani during his current visit to New York.