Messages from different dimensions conveyed by a single-digit number are complex. Sometimes people need to focus on the most practical and relevant ones and ignore the others. We designed a working memory version of numerical Stroop task to figure out whether attended numerical information could be automatically encoded and kept in working memory system even when they are unrelated to the task. It turns out that irrelevant numerical information could be encoded in working memory and even interferes with physical judgments. However, in the similar procedures physical information didn’t show such power. The asymmetric results indicated that numerical information in the Stroop task of working memory enjoys distinct priority during processing.