Indeed, the beauty of these formats is that the developers made sure that all standard R rules apply, so subsetting works as for any R data.frame/matrix-like object.
[idx,] to select rows
[,idx] to select columns
where idx can be either the names of the rows or columns, or a numeric index, or a logical vector of same length of the respective dimension.