​U.S. consumer confidence fell slightly as concerns about inflation and future job prospects grew, signaling continued unease about the economy.