+1 Code works for me. The getGEO call took 97 seconds.
• 0 views
•
link
written
by
Aleksandr Levchuk
Querying Ncbi Geo By Platform Id
I want to query NCBI's GEO to get all gene expression series (GSExxxx) GEO Data Sets (GDSxxxx) corresponding to a given platform (e.g., GPL570, which corresponds to Affy's U133 Plus 2.0 chip). I can clearly screen-scrape that GPL570 page (specifically the section that notes there are 1683 "Series" on this platform), but I'd rather not.
I've checked out the page on programmatic access to GEO, but I can't find a query that will work. Any E-Util whizzes know how this would be done?
EDIT: Aargh, after further review, I realize I need GEO Data Sets (GDSxxx), not the GSEs. Following Neil's answer below for GSEs, I've scanned the Meta(gpl) list but can't find the analogous entry for GDSs. Anyone know how I can do this?
In this case I can use an eUtils query for GPL570, but since my downstream analysis is in R I'd much rather use GEOquery...
• 8,841 views
•
link
updated
by
Khalid Zuberi •
•
written
by
Andrew Su
•
written
by
Andrew Su
2 answers
I'd probably use GEOquery from Bioconductor for this (it uses EUtils queries under the hood).
Brief example:
library(GEOquery)
gpl <- getGEO("GPL570") # may take a long time
length(Meta(gpl)$series_id)
# => 1683
# the first 10 series
head(Meta(gpl)$series_id, n = 10L)
# [1] "GSE1145" "GSE1643" "GSE2109" "GSE2125" "GSE2298" "GSE2327" "GSE2328"
# [8] "GSE2397" "GSE2435" "GSE2478"
It's not the best documentation: I believe earlier versions had better examples. That said, the getGEO() and Meta() methods are in there. I spent quite some time studying the structure of GPL, GSE and GSM files, which helped. They are all quite similar with 2 parts: metadata, accessed via Meta() and a data table, accessed via Table(). I also found BioRuby's Bio::SOFT library useful - http://bioruby.org/rdoc/classes/Bio/SOFT.html.
Thanks for the feedback on documentation. I added this example to the vignette as a use case. I do assume way too much knowledge of the structure of GEO records and need to continue to improve the documentation to that end.
• 0 views
•
link
written
by
Sean Davis
Oh, just a quick FYI. GEOquery does not use eUtils under the hood. The queries are directly against NCBI GEO and are everything from reading ftp directory listings to get file listings to http GET requests to downloads from ftp.
• 0 views
•
link
written
by
Sean Davis
Another option is GEOmetadb. This is a BioConductor package and SQLite database, the tradeoff being you need to pull down all the metadata to your local system, but once you do you can make lots of fast queries. If you are handy with SQL, you can just use the database by itself or from another environment.
• 0 views
•
link
written
by
Khalid Zuberi •
Just a note here. The "pulling all the metadata to your local system" is a one-line command and is only about a 50MB download (compressed). The data are in the form of a SQLite file that can, of course, be accessed from any language with a SQLite API, so the GEOmetadb R package is not a prerequisite.
• 0 views
•
link
written
by
Sean Davis
Log in to answer this question.
I don't think you can get to GDS using GPL in GEOquery; you'll have to fall back on EUtils. You can use GPL570[ACCN] in your query.