Hello All, I am trying to perform intersection between with my bed file and vcf and I keep getting errors.my bed files is a call of all the genes in the ORFs. The following is the command I am using and the errors.
bedtools intersect -a a.vcf -b b.bed > int.txt
Error: Invalid record in file b.bed. Record is
scaffold1090size18908_225 18674 18522
This scaffold looks good to me and in the same format as the other scaffolds. what could be the problem? and please offer suggestions.
Thanks
1 answer
The BED format requires that the start position be less than the stop position. You could fix bad BED coordinates with awk, and re-sort with BEDOPS sort-bed to make sure the output is sorted correctly:
$ awk '{ if ($2 > $3) { t = $2; $2 = $3; $3 = t; } else if ($2 == $3) { $3 += 1; } print $0; }' b.bed | sort-bed - > b.fixed.bed
Look at the position fields in the error message in your question. The first position field is the start position (18674). The second position field is the stop position (18522). The BED format requires that the position fields are ordered, so that the start position is strictly less than the stop position. But 18674 > 18522, so that's not going to work.
The awk command walks through every line of your input BED file and will switch the start and stop positions, if they are ordered incorrectly, or increment the stop position, if the start and stop positions are equal. The adjusted result is piped to sort-bed so that you get fixed output that is sorted and ready to use for set operations with BEDOPS or other toolkits.
Install BEDOPS, which contains sort-bed: http://bedops.readthedocs.io/en/latest/content/installation.html#
What does your PATH contain? Run echo $PATH.
I think brew puts items in /usr/local/bin, so I would make sure that your PATH contains that directory, at least.
Did you get errors or warning messages when running brew?
Once you have sorted out installation problems, you should be able to run sort-bed --version to verify that it is installed and to get back the installed version.
Thank you Alex. I was able to do it but biostar forum won't let me post on the thread because I can only post 5 times every 6h. However, to make the awk command work, we had to add a cat in function and then pipe it into awk.
cat a.bed | awk '{ if ($2 > $3) { t = $2; $2 = $3; $3 = t; } else if ($2 == $3) { $3 += 1; } print $0; }' | sort-bed > b.fixed.bed Thanks again.
Given inputs:
$ vcf2bed < a.vcf > a.bed
$ awk '{...}' b.bed | sort-bed - > b.fixed.bed
Try bedops --intersect:
$ bedops --intersect a.bed b.fixed.bed > answer.bed
If answer.bed is a zero-byte file, then it is likely that a.bed and b.fixed.bed do not share common genomic space.
If you want to do a "sanity check" on the inputs, use --ec, i.e.:
$ bedops --ec --intersect a.bed b.fixed.bed > answer.bed
This will run slower, but identify potential formatting problems with a.bed or b.fixed.bed.
It's unlikely there are problems with b.fixed.bed if you used sort-bed as described above, as sort-bed will report formatting problems, as well. But you could catch possible issues with a.bed using --ec.
If you do not get any errors, you can (and should) remove --ec to regain performance enhancements in bedops for typical usage.
Are you actually typing the $ in your shell? Because you shouldn't, that's just used to tell you this is a shell command. Just do the following:
awk '{ if ($2 > $3) { t = $2; $2 = $3; $3 = t; } else if ($2 == $3) { $3 += 1; } print $0; }' /Volumes/500GB/pavelAssemblyBowtieIndex/genoOrfs.bed | sort-bed - > b.fixed.bed -bash
Log in to answer this question.
-
Bedtools merge but only if intersection exists
written by jrose •
-
Interpreting Bedtools Intersection Between BAM and BED Files
written by Steven Mick •
-
Bedtools intersect error
written by Inquisitive8995
-
Error using bedtools "intersect" command
written by hila •
-
Why did Bedtools intersect output a zero byte file
written by jaqx008
-
intersection, Bed file and VCF.
written by jaqx008
-
Bedtools Invalid record, record does not exist
written by menzel •
-
bedtools intersect "complete outer join"
written by graeme.thorn
-
bedtools intersect + subtract not adding up to original file?
written by asperlea •
-
How Can I Include One Bed File In Another Bed File ?
written by fmfshog •
