Prime Minister Anthony Albanese has tied the knot with partner Jodie Haydon in a low key ceremony at the Lodge in Canberra.