Source: GOP Rep. Walker Says Amash Should Lose Committee Seats