More GOP voices are backing away from Trump