ICE officials said they mostly rounded up immigrants with criminal backgrounds, but some immigrants and refugees in the U.S.