No. You can get ~1 million open access articles from ftp://ftp.ncbi.nlm.nih.gov/pub/pmc. For the other 23 million, you need to get access to full text from the publisher. Check the Genocoding project at http://text.soe.ucsc.edu/ since they are trying to mine sequences from all Pubmed and have a table on what publishers have granted access.