If the Palace gardens haven't quenched your horticultural thirst, take a trip to the Madeira Botanical Garden, which was established in 1881 by the Reid family and opened to the public in the 1960s.