Neymar scored to put PSG 2-0 up after 21 minutes at the Stade de France on Saturday, but Rennes fought back to tie the game at 2-2 and win the penalty shootout 6-5 after extra time.
Adrien Rabiot opened the scoring for PSG in the 21st minute followed smartly by Lucas Deaux's own goal, with Javier Pastore and Marquinhos completing the round of 32 win after the break.