Building permits, stock prices and jobless benefit claims all weighed on the index, more than offsetting improvements in the interest rate spread and consumer expectations, the Conference Board said.