It's quite common to filter transcripts on both expression (read counts) and the isoform fraction (fraction of gene expression originating from each isoform) so sounds like a good plan. Just make sure that you calculate your gene expression before doing that filtering (aka the transcript removal should not effect the gene expression).