U.S. new-vehicle inventory dropped in April as tariff concerns slowed production and pushed average prices to new highs.