A simple yet beautiful Catholic church in Invercargill, St. Mary's Basilica is another must-visit attraction in Invercargill. The church was designed in a shape of basilica by the New Zealand architect Francis Petre. Listed as Category I Historic Place, St. Mary’s Basilica is visited by a large number of tourists every year who are in Invercargill. The church was first opened in the year 1905.