Good afternoon.
Has anybody experienced scraping the http://tabs.craic.com database? I'm trying to use Python for that purpose, but my code won't work:
import requests
from requests import HTTPBasicAuth
page = requests.get("http://tabs.craic.com/sequences/1.html", auth=HTTPBasicAuth("my_name", "my_passw"))
print page.text
I'm legal user, i.e I've access token and all the rights, but the page I'm trying to access is not what I wanted. Is there something wrong with my code?
•
written
by
rail.suleymanov •
1 answer
I suppose commercial databases just don't welcome your scraping. It could even be illegal.
Try these
Thera-SAbDab
http://opig.stats.ox.ac.uk/webapps/newsabdab/therasabdab/search/
free
NIH
https://antibodies.cancer.gov/browse
free
Tabs
https://tabs.craic.com
paid/trial
IMGT
http://www.imgt.org/mAb-DB/
free
Kabat
http://www.abysis.org/
free
AdisInsight
http://www.adisinsight.com/
paid
Log in to answer this question.
-
urllib.error.HTTPError: HTTP Error 400: Bad Request with biopython Entrez
written by marine.bergot •
-
Using a python script to upload data to benchling - getting a HTTP status code: 400 error
written by Zach G •
-
My ensembl requests are suddenly very slow - why?
written by ngarber •
-
Cannot install NumPy using pip and import it
written by Chvatil
-
Ensembl API, command-line argument
written by oars
-
Using UniProt's Retrieve/ID mapping service programmatically
written by ladypurrsia •
-
Rsync and python for ftp.ncbi
written by andrewsanchez •
-
Bio.Entrez - Get virus host name using NCBI Taxonomy db
written by beegrackle
-
Error With Kegg Api Sample Code For Python
written by JRCX •
-
Error In Bioperl Get Adaptor
written by Davy
http://tabs.craic.com/static_pages/3 "You may NOT transfer data from the Service using automated scripts or other automated data transfer software with express written permission from Craic Computing."
The wording of that clause suggests you can transfer data as long as you don't have written permission. I wouldn't do it, but...that is a bad typo.