The couple has a rare publique appearance