This is a test version of Biostars. For the public version, visit https://www.biostars.org.
Is there an easy way to scrape a whole bunch of NCBI RefSeq FASTA from NCBI?

I'm looking to get all the NCBI reference genomes for organisms of the following groups:

  • The phylum Prasinodermophyta
  • The phylum Rhodophyta
  • The class Phaeophyceae
  • The phylum Cyanobacteria

I know that for downloading reads, it can be as simple as downloading a bunch of SRA accession numbers off of NCBI and then getting access to all that FASTQ data (using a nice pipeline like nf-core/fetchngs), but is there a similar way to get easy access to all the FASTA data to pull all these genomes off of NCBI?

fasta genome ncbi
• 1,201 views • link
updated by shenwei356 shenwei356 • written by Mark • Mark

1 answer

I think what you want is NCBI datasets.

https://www.ncbi.nlm.nih.gov/datasets/docs/v2/download-and-install/

download genome taxon --preview prints which genomes it would download, remove the --preview flag to download.

For Rhodophyta,

datasets download genome taxon --preview Rhodophyta

prints

Collecting 68 genome records [================================================] 100% 68/68
{"resource_updated_on":"2024-10-19T03:30:15Z","record_count":68,"estimated_file_size_mb":181,"included_data_files":{"all_genomic_fasta":{"file_count":54,"size_mb":2177.4822}}}

So it would download 68 genomes.

Of these, 3 are RefSeq:

datasets download genome taxon --preview Rhodophyta --assembly-source RefSeq

Check the help, you can also add protein, rna, or other datatypes for the download. Any taxon level is fine as long as it's in NCBI Taxonomy.

• 0 views • link
written by Philipp Bayer Philipp Bayer

Log in to answer this question.

More posts like this