Automating Web Server Queries when no Local Executable Available
If you find yourself in a situation where you need to make a large number of queries to some web server, and no local executable has been made available, is there a common way to circumvent this?
Answering my own question: a few python libraries exist for this sort of thing, two examples are scrapy and mechanize.
• 1,515 views
•
link
written
by
asdfxzsdf2 •
0 answers
No answers yet.
Log in to answer this question.
More posts like this
-
Trio haplotype information in the 1000 Genome Project
written by Jesper •
-
Tool: trackplot: Fast and minimal dependency standalone R script to generate IGV style locus tracks…
written by poisonAlien
-
Fragments for proteins with known structure for use in Rosetta
written by aa •
-
Updating data from UCSC
written by Ron
-
Vcf Library/Parser That Lets You Add New Entries, Fields, Etc
written by DG
-
It Architecture For Large, Genomic Data-Backed Application
written by woemler
-
Integrating A Local Galaxy Instance With Cluster Or Cloud Compute Resources?
written by Adam Cornwell
-
Tool: Intermine: A Flexible Data Warehouse System For Biological Data
written by Jelena Aleksic
-
Recommend Your Favorite User Interfaces For Public Web-Based Datasets -- And Tell Why
written by Alex Paciorkowski
-
Biomart Very Slow
written by Chris Miller
Be a good citizen when doing this. Many bioinformatics (related) sites have norms published about how many queries you are allowed to do per unit time using programmatic means.
You are rather vague about which web server(s) you want to query, but for some applications it's also possible to download the database for offline use.