St Mary's Cathedral is a Roman Catholic church in the CBD, easily accessible via public transport and a short walk from St. James station. The original chapel burnt down in 1865 and a unique gothic style cathedral was rebuilt in its place.
Tip: If you're in Sydney during Winter you can ice skate at Cathedral Square in front of the church. If you're visiting Sydney around Christmas you can see the 'Lights of Christmas' light show!