Duncan to snub Olympics over job interference