I guess one could try and memorise the speech.
Bullet points have worked for me in the past - I've never been best man, but have spoken at more than a few graduation ceremonies. That way, you can try and remember the speech, but if you get lost you can get back on track quickly without scanning through pages of script.