Dear community,
I'm trying to download a small Entrez dataset using eutils. I use three strategies (i.e. libraries) to do that : bioperl, biopython and requests python library.
Unfortunately, the download is not robust : the result is often empty (the request status code is 200, but the XML contains an error).
<eSummaryResult>
<ERROR>Unable to obtain query #1</ERROR>
</eSummaryResult>
I use an epost command with a small set of GI (10 - 100). Webenv - query_key - retstart - retmax attributes are used to build an Epost or Esummary request.
If I paste the dynamic URL in my favorite browser, it works ! Relaunch the code, it works ! Relaunch the code, error !
I'm really disappointed... Have you any idea about what I missed ?
Thanks
•
written
by
charles.hebert •
I just want to add that I experience the same problem with eUtils (in my case, I am using a PHP script, but the bug is indeed independent of the implementation). I ran the same script last year, and it worked without these errors, so the problem seems to be caused by the eUtils server.
After more researching, I found that the most common solution to the problem is to simply do automated re-trys until the eUtils server responds properly again. That seems to work.
It is also important to note that NCBI requests user to not make more than 3 request per second. See here: http://www.ncbi.nlm.nih.gov/books/NBK25497/ From my expirence it seems that you will get random errors if you do not comply with this rule.
Log in to answer this question.
You will have to show your code if you want a helpful response. It is not possible to diagnose your issues otherwise.
The code is quite simple. Using biopython (as described in the tutorial)
Get webenv / query key using Entrez.epost(db="nuccore", id="417075336,407894523")
This behavior occurs randomly, even if I manually build the request (using urllib or requests) and parse the XML.
(nota : sleep of 1 second between each query) Maybe an eutils bugs ?
that does not look like Python code.
Pseudo code + the biopython Entrez.esummary call.
I don't know which tutorial that is, but it is not the Biopython tutorial, which contains lots of useful EUtils code examples.
I use the epost / esummary command. As I said before, the request is ok (code 200) but randomly contains an "Unable to obtain query #1". This behavior occurs randomly and the bug is not linked to a specific library (bioperl / biopython / requests / direct use of urllib2...). If I paste the same URL in a browser, it works.