A few reads mapped to a gene in an experiment that otherwise "worked" (not DNA contamination) is often going to represent expression. The opposite (no reads) does not imply lack of expression, though. To answer your question directly, I don't know of an ideal systematic way to call a gene expressed or not expressed in RNA-seq. As usual, the best way to think of expression data is in the setting of differential relative expression, not absolute expression.