The big and tall retailer said the economic uncertainty prompted customers to move from designer brands to private labels.