"I knew it was you, Fredo. You broke my heart. You broke my heart."

What exactly was it that Fredo did? I know he betrayed Michael, but...