Prime Minister Anthony Albanese has confirmed he will attend the inauguration of Pope Leo XIV following his first visit to Indonesia since this month's election.