The Caroline of "Sweet Caroline" (the Neil Diamond song) is Caroline Kennedy, JFK’s daughter (who just turned 50, if you can believe that). Neil Diamond revealed this in a recent interview.
By the way, the song has returned to the singles charts, due in large part to the Red Sox Nation (the song is played at every home game).