Peeling the Orange Rhyme:

Douglas R. Hofstadter can trump you all on the "rhymes with orange" topic:

From Tom Lehrer (via "Le Ton Beau de Marot", an excellent book by Douglas R. Hofstadter, one-time author of the Mathematical Recreations column of Scientific American)

        Eating an orange
                while making love
        Makes for bizarre enj-
                oyment thereof

From DRH himself:

        "Make love with an orange,"
                our teacher Tom toots,
        "And you'll harvest bizarre, ing-
                enious fruits!"

Or, an entire poem with Rhymes of Orange on every line from the same DRH:

        A poem without "or-
                ange" as a rhyme is not nice --
        it's a bustling bazaar
                in Jodhpur, with no spice.
        It's a Friday night bar
                in Georgetown, without ice,
        It is Deborah Kerr
                'n John Wayne -- Yul look twice!
        Tiger Woods chipping far
                and just missing -- no dice!
        Yankees blurting "Au revoir"
                in Japan, East/West splice!
        Or a Volkswagen car
                engine smoking -- ach, Scheiß!
        A poem without "or-
                ange" as a rhyme is not nice.