<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>生信菜鸟团 &#187; vcf</title>
	<atom:link href="http://www.bio-info-trainee.com/tag/vcf/feed" rel="self" type="application/rss+xml" />
	<link>http://www.bio-info-trainee.com</link>
	<description>欢迎去论坛biotrainee.com留言参与讨论，或者关注同名微信公众号biotrainee</description>
	<lastBuildDate>Sat, 28 Jun 2025 14:30:13 +0000</lastBuildDate>
	<language>zh-CN</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>https://wordpress.org/?v=4.1.33</generator>
	<item>
		<title>用GEMINI来探索vcf格式的突变数据</title>
		<link>http://www.bio-info-trainee.com/1603.html</link>
		<comments>http://www.bio-info-trainee.com/1603.html#comments</comments>
		<pubDate>Thu, 05 May 2016 11:39:37 +0000</pubDate>
		<dc:creator><![CDATA[ulwvfje]]></dc:creator>
				<category><![CDATA[基础数据库]]></category>
		<category><![CDATA[基础软件]]></category>
		<category><![CDATA[gemini]]></category>
		<category><![CDATA[mysql]]></category>
		<category><![CDATA[sneff]]></category>
		<category><![CDATA[vcf]]></category>
		<category><![CDATA[VEP]]></category>

		<guid isPermaLink="false">http://www.bio-info-trainee.com/?p=1603</guid>
		<description><![CDATA[第一次听说这个软件，是一个香港朋友推荐的：http://davetang.org &#8230; <a href="http://www.bio-info-trainee.com/1603.html">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description>
				<content:encoded><![CDATA[<p>第一次听说这个软件，是一个香港朋友推荐的：<a href="http://davetang.org/muse/2016/01/13/getting-started-with-gemini/">http://davetang.org/muse/2016/01/13/getting-started-with-gemini/</a> 他写的很棒，但是我当初以为是一个类似于SQLite的数据库浏览模式，所以没在意。实际上，我现在仍然觉得这个软件没什么用！</p>
<p>软件官网有详细的介绍：<a href="https://gemini.readthedocs.io/en/latest/">https://gemini.readthedocs.io/en/latest/</a></p>
<p>而且提供丰富的教程：</p>
<p>We recommend that you follow these tutorials in order, as they introduce concepts that build upon one another.</p>
<ul>
<li>Introduction to GEMINI, basic variant querying and data exploration. <a href="https://speakerdeck.com/arq5x/an-introduction-and-tutorial-for-variant-exploration-with-gemini">html</a> <a href="https://s3.amazonaws.com/gemini-tutorials/Intro-To-Gemini.pdf">pdf</a></li>
<li>Identifying de novo mutations underlying Mendelian disease <a href="https://speakerdeck.com/arq5x/identifying-de-novo-mutations-with-gemini">html</a> <a href="https://s3.amazonaws.com/gemini-tutorials/Gemini-DeNovo-Tutorial.pdf">pdf</a></li>
<li>Identifying autosomal recessive variants underlying Mendelian disease <a href="https://speakerdeck.com/arq5x/identifying-recessive-candidates-with-gemini">html</a> <a href="https://s3.amazonaws.com/gemini-tutorials/Gemini-Recessive-Tutorial.pdf">pdf</a></li>
<li>Identifying autosomal dominant variants underlying Mendelian disease <a href="https://speakerdeck.com/arq5x/identifying-dominant-candidates-with-gemini">html</a> <a href="https://s3.amazonaws.com/gemini-tutorials/Gemini-Dominant-Tutorial.pdf">pdf</a></li>
<li>Other GEMINI tools <a href="https://speakerdeck.com/arq5x/other-gemini-tools">html</a> <a href="https://s3.amazonaws.com/gemini-tutorials/GEMINI-Other-Tools.pdf">pdf</a></li>
</ul>
<p>软件本身并不提供注释，虽然它的功能的确包括注释，号称可以利用(ENCODE tracks, UCSC tracks, OMIM, dbSNP, KEGG, and HPRD.)对你的突变位点注释，比如你输入1       861389  .       C       T       ，它告诉你这个突变发生在哪个基因，对蛋白改变如何？是否会产生某些疾病？</p>
<p>虽然它本身没有注释功能，但是它会调用snpEFF或者VEP进行注释，你需要自己先学习它们。</p>
<p><a href="http://www.bio-info-trainee.com/wp-content/uploads/2016/05/12.png"><img class="alignnone size-full wp-image-1604" src="http://www.bio-info-trainee.com/wp-content/uploads/2016/05/12.png" alt="1" width="523" height="305" /></a></p>
<h1><span style="color: #ff0000;">软件安装：</span></h1>
<p>GEMINI是用python写的，有一个小脚本可以自动完成安装过程：</p>
<p>7.3K May  4 14:44 gemini_install.py</p>
<p>下载这个脚本，然后安装即可</p>
<p>wget https://github.com/arq5x/gemini/raw/master/gemini/scripts/gemini_install.py</p>
<p>python gemini_install.py $tools $data</p>
<p>PATH=$tools/bin:$data/anaconda/bin:$PATH</p>
<p>where <em>$tools</em> and <em>$data</em> are paths writable on your system.</p>
<p>我把$tools用的就是当前文件夹，$data也是当前文件夹下面的gemini文件夹。</p>
<p>这样就会在当前文件夹下面生成两个文件夹，bin是存储程序，gemini是存储数据用的，而且注意要把bin目录的全路径添加到环境变量！</p>
<h1><span style="color: #ff0000;">输入数据：</span></h1>
<p>我们可以直接下载软件作者提供的测试数据</p>
<p>首先是22号染色体的所有突变位点经过WEP注释的文件</p>
<p>然后是一个三口直接的突变ped格式数据</p>
<p>数据存放在亚马逊云，所有的教程pdf也在</p>
<p><a href="http://s3.amazonaws.com/gemini-tutorials">http://s3.amazonaws.com/gemini-tutorials</a></p>
<p>如果是你自己的vcf文件，需要自己用VEP注释一下</p>
<p><a href="http://www.bio-info-trainee.com/wp-content/uploads/2016/05/13.png"><img class="alignnone size-full wp-image-1606" src="http://www.bio-info-trainee.com/wp-content/uploads/2016/05/13.png" alt="1" width="271" height="56" /></a></p>
<h1><span style="color: #ff0000;">运行命令：</span></h1>
<p><a href="http://www.bio-info-trainee.com/wp-content/uploads/2016/05/2.png"><img class="alignnone size-full wp-image-1605" src="http://www.bio-info-trainee.com/wp-content/uploads/2016/05/2.png" alt="2" width="419" height="154" /></a></p>
<h1><span style="color: #ff0000;">结果解读：</span></h1>
<p>产生是chr22.db就是一个数据库格式的文件，但是需要用gemini 来进行查询，个人认为，并没有多大意思！</p>
<p>你只要熟悉mySQL等SQL语言，完全可以自己来！</p>
]]></content:encoded>
			<wfw:commentRss>http://www.bio-info-trainee.com/1603.html/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>用VEP对vcf格式的突变数据进行注释</title>
		<link>http://www.bio-info-trainee.com/1600.html</link>
		<comments>http://www.bio-info-trainee.com/1600.html#comments</comments>
		<pubDate>Thu, 05 May 2016 11:35:50 +0000</pubDate>
		<dc:creator><![CDATA[ulwvfje]]></dc:creator>
				<category><![CDATA[基础数据库]]></category>
		<category><![CDATA[基础软件]]></category>
		<category><![CDATA[vcf]]></category>
		<category><![CDATA[VEP]]></category>
		<category><![CDATA[突变]]></category>

		<guid isPermaLink="false">http://www.bio-info-trainee.com/?p=1600</guid>
		<description><![CDATA[VEP是国际三大数据库之一的ENSEMBL提供的，也是非常主流和方便，但它是基于 &#8230; <a href="http://www.bio-info-trainee.com/1600.html">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description>
				<content:encoded><![CDATA[<p>VEP是国际三大数据库之一的ENSEMBL提供的，也是非常主流和方便，但它是基于perl语言的，所以在模块方面可能会有点烦人。跟snpEFF一样，也是对遗传变异信息提供更具体的注释，而不仅仅是基于位点区域和基因。如果你熟悉外显子联盟这个数据库EXAC(<strong>ExAC.r0.3.sites.vep.vcf.gz</strong>)，你可以下载它所有的突变记录数据，看看它对每个变异位点到底注释了些什么，它就是典型的用VEP来注释的。<span id="more-1600"></span></p>
<p>随便一个位点，注释了如此多的信息！~~~</p>
<p>1       861389  .       C       T       5621.53 PASS    AC=4;AC_AFR=0;AC_AMR=0;AC_Adj=4;AC_EAS=0;AC_FIN=0;AC_Het=4;AC_Hom=0;AC_NFE=3;AC_OTH=1;AC_SAS=0;AF=3.300e-05;AN=121216;AN_AFR=10212;AN_AMR=11516;AN_Adj=119730;AN_EAS=8606;AN_FIN=6594;AN_NFE=65414;AN_OTH=890;AN_SAS=16498;BaseQRankSum=2.78;ClippingRankSum=-2.380e-01;DP=1488042;FS=7.913;GQ_MEAN=62.49;GQ_STDDEV=14.73;Het_AFR=0;Het_AMR=0;Het_EAS=0;Het_FIN=0;Het_NFE=3;Het_OTH=1;Het_SAS=0;Hom_AFR=0;Hom_AMR=0;Hom_EAS=0;Hom_FIN=0;Hom_NFE=0;Hom_OTH=0;Hom_SAS=0;InbreedingCoeff=-0.0004;MQ=59.70;MQ0=0;MQRankSum=0.198;NCC=409;QD=15.11;ReadPosRankSum=0.561;VQSLOD=0.392;culprit=FS;DP_HIST=373|361|219|102|34981|16744|5493|1367|498|210|121|54|32|18|13|9|3|3|3|4,0|0|0|0|0|0|0|0|0|0|0|1|0|0|0|0|0|1|1|1;GQ_HIST=26|352|26|24|472|62|71|34|23|29|34|16|44468|8058|2176|2147|1116|370|365|739,0|0|0|0|0|0|0|0|0|0|0|0|0|0|0|0|0|0|0|4;CSQ=T|ENSG00000187634|ENST00000420190|Transcript|missense_variant|157|68|23|P/L|cCg/cTg||1||1|SAMD11|HGNC|28706|protein_coding|||ENSP00000411579||Q5SV95_HUMAN&amp;I7FV93_HUMAN&amp;A6PWC8_HUMAN|UPI000155D47C|deleterious(0)|probably_damaging(0.999)|2/7|||ENST00000420190.1:c.68C&gt;T|ENSP00000411579.1:p.Pro23Leu||||||||||||||||||,T|ENSG00000268179|ENST00000598827|Transcript|missense_variant|211|211|71|G/R|Ggg/Agg||1||-1|AL645608.1|Clone_based_ensembl_gene||protein_coding|YES||ENSP00000471152||M0R0C9_HUMAN|UPI0000D61E05||probably_damaging(0.98)|6/6|||ENST00000598827.1:c.211G&gt;A|ENSP00000471152.1:p.Gly71Arg||||||||||||||||||,T|ENSG00000187634|ENST00000437963|Transcript|missense_variant|128|68|23|P/L|cCg/cTg||1||1|SAMD11|HGNC|28706|protein_coding|||ENSP00000393181||Q5SV95_HUMAN&amp;I7FV93_HUMAN|UPI000155D47B|deleterious(0)|probably_damaging(0.999)|2/5|||ENST00000437963.1:c.68C&gt;T|ENSP00000393181.1:p.Pro23Leu||||||||||||||||||,T|ENSG00000187634|ENST00000342066|Transcript|missense_variant|151|68|23|P/L|cCg/cTg||1||1|SAMD11|HGNC|28706|protein_coding|YES|CCDS2.2|ENSP00000342313|SAM11_HUMAN|Q5SV95_HUMAN&amp;I7FV93_HUMAN&amp;A6PWC8_HUMAN|UPI0000D61E04|deleterious(0)|probably_damaging(0.999)|2/14|||ENST00000342066.3:c.68C&gt;T|ENSP00000342313.3:p.Pro23Leu||||||||||||||||||,T||ENSR00000528850|RegulatoryFeature|regulatory_region_variant|||||||1||||||regulatory_region|||||||||||||||||||||||||||||||</p>
<p>头文件里面有对每一列的详细介绍，包括突变的标准格式</p>
<p>HGVS.c   --》ENST00000420190.1:c.68C&gt;T</p>
<p>HGVS.p –》ENSP00000411579.1:p.Pro23Leu</p>
<p>还有该突变对蛋白功能的影响，包括sift和polyphen的打分~~~</p>
<p>不多说了，直接介绍该软件如何使用吧！</p>
<p>&nbsp;</p>
<h1><span style="color: #ff0000;">软件安装：</span></h1>
<p>最新版是84：<a href="http://useast.ensembl.org/info/docs/tools/vep/script/vep_download.html">http://useast.ensembl.org/info/docs/tools/vep/script/vep_download.html</a></p>
<p>然后进入目录用perl的形式来安装这个软件：perl INSTALL.pl 即可</p>
<p>安装时其实有很多参数可以选择的，请仔细阅读介绍；<a href="http://useast.ensembl.org/info/docs/tools/vep/script/vep_download.html">http://useast.ensembl.org/info/docs/tools/vep/script/vep_download.html</a></p>
<p>&nbsp;</p>
<p>前提是你已经安装好了两个模块！</p>
<p>perl -e 'use DBD::mysql'</p>
<p>perl -e 'use Archive::Extract'</p>
<p>如果不报错，就证明你已经安装过这些模块，如果报错，去搜索我以前关于perl模块的博客吧，不是很简单的事情。</p>
<p>By default the script will install the cache files in the ".vep" subdirectory of the user's home area. Using this option users can configure where cache files are installed.</p>
<p>我不想把cache文件放在默认的$HOME/.vep/下面，所以我安装的时候稍微做了更改</p>
<p>&nbsp;</p>
<p>下载完了软件，接下来就要下载注释用的数据库啦！</p>
<p>它支持非常多的物种的注释，我这里拿人类做例子咯：<a href="ftp://ftp.ensembl.org/pub/release-82/variation/VEP/">ftp://ftp.ensembl.org/pub/release-82/variation/VEP/</a></p>
<p>我下载的是ftp里面的82 版本： wget <a href="ftp://ftp.ensembl.org/pub/release-82/variation/VEP/homo_sapiens_refseq_vep_82_GRCh37.tar.gz">ftp://ftp.ensembl.org/pub/release-82/variation/VEP/homo_sapiens_refseq_vep_82_GRCh37.tar.gz</a></p>
<p>有6.1G，所以会有点耗时~</p>
<p>下载完毕后直接用tar –zxvf解压即可使用啦！</p>
<p>我安装软件的时候指定了cache目录，而不是默认的$HOME/.vep/</p>
<blockquote><p>&nbsp;</p>
<p>Download the archive file for your species</p>
<p>Extract the archive in your cache directory. By default the VEP uses $HOME/.vep/ as the cache directory, where $HOME is your UNIX home directory.</p>
<p>mv homo_sapiens_vep_84.tar.gz ~/.vep/ cd ~/.vep/tar xfz homo_sapiens_vep_84.tar.gz</p>
<p>Run the VEP with the<a href="http://useast.ensembl.org/info/docs/tools/vep/script/vep_options.html#opt_cache">--cache</a> option</p></blockquote>
<p>所以要把下载的6.1G数据库放在我自己的cashe目录</p>
<p>如果你安装VEP的时候用的默认安装参数，就需要把自己下载的6.1G文件放在  ~/.vep/ 目录下面</p>
<p>参考：<a href="http://davetang.org/wiki2/index.php?title=VEP">http://davetang.org/wiki2/index.php?title=VEP</a></p>
<h1><span style="color: #ff0000;">输入数据：</span></h1>
<p>它支持好几种输入格式数据:</p>
<ul>
<li><a href="http://useast.ensembl.org/info/website/upload/bed.html">BED</a>: a simple tab-delimited format containing 3-12 columns of data. The first 3 columns contain the coordinates of the feature. If available, the VEP will use the 4th column of the file as the identifier of the feature.</li>
<li><a href="http://www.sanger.ac.uk/resources/software/gff/">GFF</a>: a format for describing genes and other features. If available, the VEP will use the "ID" field as the identifier of this feature.</li>
<li><a href="http://useast.ensembl.org/info/website/upload/gff.html">GTF</a>: treated in an identical manner to GFF.</li>
<li><a href="http://www.1000genomes.org/wiki/Analysis/Variant%20Call%20Format/vcf-variant-call-format-version-41">VCF</a>: a format used to describe genomic variants. The VEP will use the 3rd column of the file as the identifier.</li>
<li><a href="http://genome.ucsc.edu/goldenPath/help/bigWig.html">bigWig</a>: a format for storage of dense continuous data. The VEP uses the value for the given position as the "identifier". Note that bigWig files contain their own indices, and do not need to be indexed by tabix.</li>
</ul>
<p>Any other files can be easily converted to be compatible with the VEP; the easiest format to produce is a BED-like file containing coordinates and an (optional) identifier:</p>
<p>其实重点就是给出你的突变的坐标即可，在哪条染色体，什么位置！</p>
<p>我们可以拿snpEFF里面的example文件夹里面的数据来做测试。</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<h1><span style="color: #ff0000;">运行命令：</span></h1>
<p>可以直接进入安装目录(VEP_ensembl/ensembl-tools-release-84/scripts/variant_effect_predictor)运行那个主程序</p>
<p>variant_effect_predictor.pl -i example_GRCh37.vcf \</p>
<p>--cache --assembly GRCh37 \</p>
<p>--offline --force_overwrite</p>
<p>或者用全路径的形式去调用这个程序</p>
<p>参数非常复杂，详细介绍见：<a href="http://useast.ensembl.org/info/docs/tools/vep/script/vep_options.html">http://useast.ensembl.org/info/docs/tools/vep/script/vep_options.html</a></p>
<p>一般用标准参数就好啦，而且还有一些插件，其中我比较喜欢<a href="https://github.com/ensembl-variation/VEP_plugins/blob/master/dbNSFP.pm">dbNSFP</a> and <a href="https://github.com/konradjk/loftee">LOFTEE</a> plugins，这也是EXAC里面用过的。</p>
<p><a href="http://www.bio-info-trainee.com/wp-content/uploads/2016/05/3.png"><img class="alignnone size-full wp-image-1601" src="http://www.bio-info-trainee.com/wp-content/uploads/2016/05/3.png" alt="3" width="753" height="437" /></a></p>
<p>&nbsp;</p>
<h1><span style="color: #ff0000;">结果解读：</span></h1>
<p>这个非常复杂，对结果理解了多少，就是我们对软件理解了多少。</p>
<p>具体大家看readme吧，注释信息太多了，按需索取：</p>
<p>直接看EXAC(<strong>ExAC.r0.3.sites.vep.vcf.gz</strong>)文件里面近一亿条突变记录也能慢慢理解！</p>
<p>&nbsp;</p>
<p>参考：<a href="http://gemini.readthedocs.io/en/latest/content/functional_annotation.html">http://gemini.readthedocs.io/en/latest/content/functional_annotation.html</a></p>
<p>&nbsp;</p>
<h1>2018年更新：</h1>
<p><span class="md-line md-end-block">为了其它软件的顺利运行，我们根据教程来设置默认的安装目录及变量环境：<span class=""><a spellcheck="false" href="http://useast.ensembl.org/info/docs/tools/vep/index.html">Ensembl's VEP</a></span> ， If you don't have <span class=""><a spellcheck="false" href="http://useast.ensembl.org/info/docs/tools/vep/index.html">VEP</a></span> installed, then <span class=""><a spellcheck="false" href="https://gist.github.com/ckandoth/f265ea7c59a880e28b1e533a6e935697">follow this gist</a></span>. </span></p>
<pre class="md-fences md-end-block" lang="shell" contenteditable="false"><span class="cm-keyword">export</span> <span class="cm-def">VEP_PATH</span><span class="cm-operator">=</span><span class="cm-def">$HOME</span>/vep
<span class="cm-keyword">export</span> <span class="cm-def">VEP_DATA</span><span class="cm-operator">=</span><span class="cm-def">$HOME</span>/.vep
<span class="cm-builtin">mkdir</span> <span class="cm-def">$VEP_PATH</span> <span class="cm-def">$VEP_DATA</span>; <span class="cm-builtin">cd</span> <span class="cm-def">$VEP_PATH</span>
<span class="cm-keyword">export</span> <span class="cm-def">PERL5LIB</span><span class="cm-operator">=</span><span class="cm-def">$VEP_PATH</span>:<span class="cm-def">$PERL5LIB</span>
<span class="cm-keyword">export</span> <span class="cm-def">PATH</span><span class="cm-operator">=</span><span class="cm-def">$VEP_PATH</span>/htslib:<span class="cm-def">$PATH</span>
<span class="cm-comment">## 这一块代码就创建文件夹和下载数据，理论上不会出错，取决于网速</span>
 perl <span class="cm-attribute">-e</span> <span class="cm-string">'{print join"\n",@INC}'</span>
 <span class="cm-comment">## 这种临时添加perl模块路径的方法不好用，需要修改 </span>
 <span class="cm-builtin">source</span>   ~/.bashrc
 
<span class="cm-builtin">curl</span> <span class="cm-attribute">-LO</span> https://github.com/Ensembl/ensembl-tools/archive/release/86.tar.gz
tar <span class="cm-attribute">-zxf</span> <span class="cm-number">86</span>.tar.gz <span class="cm-attribute">--starting-file</span> variant_effect_predictor <span class="cm-attribute">--transform</span><span class="cm-operator">=</span><span class="cm-string">'s|.*/|./|g'</span></pre>
<h3 class="md-end-block md-heading">基因组数据库下载</h3>
<p><span class="md-line md-end-block md-focus">Download and unpack VEP's offline cache for GRCh37, GRCh38, and GRCm38:</span></p>
<pre class="md-fences md-end-block" lang="shell" contenteditable="false"><span class="cm-builtin">cd</span> <span class="cm-def">$VEP_DATA</span>
rsync <span class="cm-attribute">-zvh</span> rsync://ftp.ensembl.org/ensembl/pub/release-86/variation/VEP/homo_sapiens_vep_86_GRCh37.tar.gz <span class="cm-def">$VEP_DATA</span>
rsync <span class="cm-attribute">-zvh</span> rsync://ftp.ensembl.org/ensembl/pub/release-86/variation/VEP/homo_sapiens_vep_86_GRCh38.tar.gz <span class="cm-def">$VEP_DATA</span>
rsync <span class="cm-attribute">-zvh</span> rsync://ftp.ensembl.org/ensembl/pub/release-86/variation/VEP/mus_musculus_vep_86_GRCm38.tar.gz <span class="cm-def">$VEP_DATA</span>
<span class="cm-builtin">cat</span> <span class="cm-def">$VEP_DATA</span>/*_vep_86_GRC{h37,h38,m38}.tar.gz | tar <span class="cm-attribute">-izxf</span> <span class="cm-attribute">-</span> <span class="cm-attribute">-C</span> <span class="cm-def">$VEP_DATA</span>
<span class="cm-comment">## 解压下载好的数据库到指定文件夹</span>
<span class="cm-comment"># 4.9G Apr 23 19:40 homo_sapiens_vep_86_GRCh38.tar.gz</span>
<span class="cm-comment">## 这一步下载的文件有点大，可能会些微耗时，一般不修改默认文件夹。</span></pre>
<p><span class="md-line md-end-block">Install the Ensembl API, the reference FASTAs for GRCh37/GRCh38/GRCm38:</span></p>
<pre class="md-fences md-end-block" lang="shell" contenteditable="false">
<span class="cm-builtin">cd</span> <span class="cm-def">$VEP_PATH</span>
<span class="cm-comment">#perl INSTALL.pl --AUTO af --SPECIES homo_sapiens --ASSEMBLY GRCh37 --DESTDIR $VEP_PATH --CACHEDIR $VEP_DATA</span>
perl INSTALL.pl <span class="cm-attribute">--AUTO</span> af <span class="cm-attribute">--SPECIES</span> homo_sapiens <span class="cm-attribute">--ASSEMBLY</span> GRCh38 <span class="cm-attribute">--DESTDIR</span> <span class="cm-def">$VEP_PATH</span> <span class="cm-attribute">--CACHEDIR</span> <span class="cm-def">$VEP_DATA</span>
<span class="cm-comment">#perl INSTALL.pl --AUTO af --SPECIES mus_musculus --ASSEMBLY GRCm38 --DESTDIR $VEP_PATH --CACHEDIR $VEP_DATA</span>
<span class="cm-comment">## 这中间会安装 BioPerl</span></pre>
<p><span class="md-line md-end-block">如果成功，会有提示，如下：</span></p>
<pre class="md-fences md-end-block" lang="" contenteditable="false"> - downloading Homo_sapiens.GRCh38.dna.primary_assembly.fa.gz
  - converting sequence data to bgzip format
 Going to run:
/home/jianmingzeng/vep/biodbhts/scripts/convert_gz_2_bgz.sh /home/jianmingzeng/.vep/homo_sapiens/86_GRCh38/Homo_sapiens.GRCh38.dna.primary_assembly.fa.gz /home/jianmingzeng/vep/htslib/bgzip
This may take some time and will be removed when files are provided in bgzip format
Converted FASTA gzip file to bgzip successfully
[fai_load] build FASTA index.
 - indexing OK
The FASTA file should be automatically detected by the VEP when using --cache or --offline. If it is not, use "--fasta /home/jianmingzeng/.vep/homo_sapiens/86_GRCh38/Homo_sapiens.GRCh38.dna.primary_assembly.fa.gz"
​
​
All done</pre>
<p><span class="md-line md-end-block">因为用到perl模块，如果你的服务器环境没有配置好，会需要一些设置；</span></p>
<pre class="md-fences md-end-block" lang="shell" contenteditable="false">
perl <span class="cm-attribute">-e</span> <span class="cm-string">'use LWP::Simple'</span>
​
<span class="cm-builtin">wget</span> <span class="cm-attribute">-O-</span> http://cpanmin.us | perl <span class="cm-attribute">-</span> <span class="cm-attribute">-l</span> ~/perl5 App::cpanminus local::lib
eval <span class="cm-quote">`perl -I ~/perl5/lib/perl5 -Mlocal::lib`</span>
<span class="cm-builtin">echo</span> <span class="cm-string">'eval `perl -I ~/perl5/lib/perl5 -Mlocal::lib`'</span> &gt;&gt; ~/.profile
<span class="cm-builtin">echo</span> <span class="cm-string">'export MANPATH=$HOME/perl5/man:$MANPATH'</span> &gt;&gt; ~/.profile
<span class="cm-builtin">source</span> ~/.profile
​
cpanm <span class="cm-attribute">-v</span> <span class="cm-attribute">--notest</span> <span class="cm-attribute">-l</span> ~/perl5  Archive::Extract;
cpanm <span class="cm-attribute">-v</span> <span class="cm-attribute">--notest</span> <span class="cm-attribute">-l</span> ~/perl5  Archive::Zip;
cpanm <span class="cm-attribute">-v</span> <span class="cm-attribute">--notest</span> <span class="cm-attribute">-l</span> ~/perl5  HTML::Entities;
cpanm <span class="cm-attribute">-v</span> <span class="cm-attribute">--notest</span> <span class="cm-attribute">-l</span> ~/perl5  LWP::Simple;
cpanm <span class="cm-attribute">-v</span> <span class="cm-attribute">--notest</span> <span class="cm-attribute">-l</span> ~/perl5  Compress::Zlib;
perl <span class="cm-attribute">-e</span> <span class="cm-string">'use Archive::Extract'</span>
perl <span class="cm-attribute">-e</span> <span class="cm-string">'use HTML::Entities'</span>
perl <span class="cm-attribute">-e</span> <span class="cm-string">'use HTML::HeadParser'</span>
perl <span class="cm-attribute">-e</span> <span class="cm-string">'use LWP::Simple'</span>
perl <span class="cm-attribute">-e</span> <span class="cm-string">'use Archive::Zip'</span>
perl <span class="cm-attribute">-e</span> <span class="cm-string">'use Compress::Zlib'</span>
​
cpanm <span class="cm-attribute">-v</span> <span class="cm-attribute">--notest</span> <span class="cm-attribute">-l</span> ~/perl5  DBD::mysql;
perl <span class="cm-attribute">-e</span> <span class="cm-string">'use DBD::mysql'</span>
​</pre>
<p><span class="md-line md-end-block">Convert the offline cache for use with tabix, that significantly speeds up the lookup of known variants:</span></p>
<pre class="md-fences md-end-block" lang="shell" contenteditable="false">
<span class="cm-comment">#perl convert_cache.pl --species homo_sapiens --version 86_GRCh37 --dir $VEP_DATA</span>
perl convert_cache.pl <span class="cm-attribute">--species</span> homo_sapiens <span class="cm-attribute">--version</span> 86_GRCh38 <span class="cm-attribute">--dir</span> <span class="cm-def">$VEP_DATA</span>
<span class="cm-comment">#perl convert_cache.pl --species mus_musculus --version 86_GRCm38 --dir $VEP_DATA</span>
<span class="cm-comment">## 这个步骤特别耗时</span></pre>
<p><span class="md-line md-end-block">更多细节去看我以前在生信菜鸟团博客分享的笔记：<span spellcheck="false"><a href="http://www.bio-info-trainee.com/1600.html">http://www.bio-info-trainee.com/1600.html</a></span> </span></p>
<p><span class="md-line md-end-block">安装过程如下：</span></p>
<pre class="md-fences md-end-block" lang="" contenteditable="false">
2018-04-27 13:42:12 - Processing homo_sapiens
2018-04-27 13:42:12 - Processing version 86_GRCh38
2018-04-27 13:42:12 - Processing _var cache type
[===========================================================]  [ 100% ]
2018-04-27 14:59:39 - All done!</pre>
<h3 class="md-end-block md-heading">下载安装关联软件</h3>
<p><span class="md-line md-end-block">Download and build <span spellcheck="false"><code>samtools</code></span> and <span spellcheck="false"><code>bcftools</code></span>, which we'll need for steps below, and when running vcf2maf/maf2maf:</span></p>
<pre class="md-fences md-end-block" lang="shell" contenteditable="false">
<span class="cm-builtin">mkdir</span> <span class="cm-def">$VEP_PATH</span>/samtools &amp;&amp; <span class="cm-builtin">cd</span> <span class="cm-def">$VEP_PATH</span>/samtools
<span class="cm-builtin">curl</span> <span class="cm-attribute">-LOOO</span> https://github.com/samtools/{samtools/releases/download/1.3.1/samtools-1.3.1,bcftools/releases/download/1.3.1/bcftools-1.3.1,htslib/releases/download/1.3.2/htslib-1.3.2}.tar.bz2
<span class="cm-builtin">cat</span> *tar.bz2 | tar <span class="cm-attribute">-ijxf</span> <span class="cm-attribute">-</span>
<span class="cm-builtin">cd</span> htslib-1.3.2 &amp;&amp; <span class="cm-builtin">make</span> &amp;&amp; <span class="cm-builtin">make</span> <span class="cm-def">prefix</span><span class="cm-operator">=</span><span class="cm-def">$VEP_PATH</span>/samtools install &amp;&amp; <span class="cm-builtin">cd</span> ..
<span class="cm-builtin">cd</span> samtools-1.3.1 &amp;&amp; <span class="cm-builtin">make</span> &amp;&amp; <span class="cm-builtin">make</span> <span class="cm-def">prefix</span><span class="cm-operator">=</span><span class="cm-def">$VEP_PATH</span>/samtools install &amp;&amp; <span class="cm-builtin">cd</span> ..
<span class="cm-builtin">cd</span> bcftools-1.3.1 &amp;&amp; <span class="cm-builtin">make</span> &amp;&amp; <span class="cm-builtin">make</span> <span class="cm-def">prefix</span><span class="cm-operator">=</span><span class="cm-def">$VEP_PATH</span>/samtools install &amp;&amp; <span class="cm-builtin">cd</span> ..
<span class="cm-builtin">cd</span> ..</pre>
<p><span class="md-line md-end-block">Download the <span spellcheck="false"><code>liftOver</code></span> binary down the same path, and make it executable:</span></p>
<pre class="md-fences md-end-block" lang="shell" contenteditable="false">
<span class="cm-builtin">curl</span> <span class="cm-attribute">-L</span> http://hgdownload.soe.ucsc.edu/admin/exe/linux.x86_64/liftOver &gt; bin/liftOver
<span class="cm-builtin">chmod</span> a<span class="cm-operator">+</span>x bin/liftOver</pre>
<p><span class="md-line md-end-block">Set $PATH to find all those tools, and also add this line to your <span spellcheck="false"><code>~/.bashrc</code></span> to make it persistent. Be sure to edit the path below, if you didn't do this in your <span spellcheck="false"><code>$HOME</code></span>:</span></p>
<pre class="md-fences md-end-block" lang="shell" contenteditable="false">
<span class="cm-keyword">export</span> <span class="cm-def">PATH</span><span class="cm-operator">=</span><span class="cm-def">$HOME</span>/vep/samtools/bin:<span class="cm-def">$PATH</span></pre>
<h3 class="md-end-block md-heading">使用VEP在真实数据</h3>
<p><span class="md-line md-end-block">一般都需要先看看帮助文件：</span></p>
<pre class="md-fences md-end-block" lang="" contenteditable="false">
 perl ~/vep/variant_effect_predictor.pl  --help
#----------------------------------#
# ENSEMBL VARIANT EFFECT PREDICTOR #
#----------------------------------#
​
version 86
by Will McLaren (wm2@ebi.ac.uk)
​
Help: dev@ensembl.org , helpdesk@ensembl.org
Twitter: @ensembl , @EnsemblWill
​

http://www.ensembl.org/info/docs/tools/vep/script/index.html

​
Usage:
perl variant_effect_predictor.pl [--cache|--offline|--database] [arguments]
​
Basic options
=============
​
--help                 Display this message and quit
​
-i | --input_file      Input file
-o | --output_file     Output file
--force_overwrite      Force overwriting of output file
--species [species]    Species to use [default: "human"]
​
--everything           Shortcut switch to turn on commonly used options. See web
                       documentation for details [default: off]
--fork [num_forks]     Use forking to improve script runtime
​
For full option documentation see:

http://www.ensembl.org/info/docs/tools/vep/script/vep_options.html</pre>
<p><span class="md-line md-end-block">一般收入数据的vcf格式的：<span spellcheck="false"><a href="http://samtools.github.io/hts-specs/VCFv4.2.pdf">http://samtools.github.io/hts-specs/VCFv4.2.pdf</a></span> </span></p>
<p><span class="md-line md-end-block">不过也没有那么标准，我给了如下：</span></p>
<pre class="md-fences md-end-block" lang="" contenteditable="false">
chr1    12861477    .   T   C   .   .   32:1:3.03%:T:23:8:25.81%
chr1    16588939    .   T   C   .   .   22:0:0%:T:8:3:27.27%
chr1    16703018    .   C   G   .   .   28:0:0%:C:21:6:22.22%</pre>
<p><span class="md-line md-end-block">处理起来毫无压力：</span></p>
<pre class="md-fences md-end-block" lang="shell" contenteditable="false">
perl ~/vep/variant_effect_predictor.pl  <span class="cm-attribute">-i</span> tmp.vcf  <span class="cm-attribute">-o</span> test.results \
<span class="cm-attribute">--cache</span> <span class="cm-attribute">--force_overwrite</span>  <span class="cm-attribute">--assembly</span> GRCh38 <span class="cm-attribute">--vcf</span></pre>
<p><span class="md-line md-end-block">得到的结果其实和snpEFF没啥子区别，反正工具嘛，顺手即可。</span></p>
<h3 class="md-end-block md-heading">其它输入数据：</h3>
<p><span class="md-line md-end-block">它支持好几种输入格式数据:</span></p>
<ul class="ul-list" data-mark="-">
<li><span class="md-line md-end-block"><span class=""><a spellcheck="false" href="http://useast.ensembl.org/info/website/upload/bed.html">BED</a></span>: a simple tab-delimited format containing 3-12 columns of data. The first 3 columns contain the coordinates of the feature. If available, the VEP will use the 4th column of the file as the identifier of the feature.</span></li>
<li><span class="md-line md-end-block"><span class=""><a spellcheck="false" href="http://www.sanger.ac.uk/resources/software/gff/">GFF</a></span>: a format for describing genes and other features. If available, the VEP will use the "ID" field as the identifier of this feature.</span></li>
<li><span class="md-line md-end-block"><span class=""><a spellcheck="false" href="http://useast.ensembl.org/info/website/upload/gff.html">GTF</a></span>: treated in an identical manner to GFF.</span></li>
<li><span class="md-line md-end-block"><span class=""><a spellcheck="false" href="http://www.1000genomes.org/wiki/Analysis/Variant%20Call%20Format/vcf-variant-call-format-version-41">VCF</a></span>: a format used to describe genomic variants. The VEP will use the 3rd column of the file as the identifier.</span></li>
<li><span class="md-line md-end-block"><span class=""><a spellcheck="false" href="http://genome.ucsc.edu/goldenPath/help/bigWig.html">bigWig</a></span>: a format for storage of dense continuous data. The VEP uses the value for the given position as the "identifier". Note that bigWig files contain their own indices, and do not need to be indexed by tabix.</span></li>
</ul>
<p><span class="md-line md-end-block">Any other files can be easily converted to be compatible with the VEP; the easiest format to produce is a BED-like file containing coordinates and an (optional) identifier:</span></p>
<p><span class="md-line md-end-block">其实重点就是给出你的突变的坐标即可，在哪条染色体，什么位置！</span></p>
<p><span class="md-line md-end-block">不过，值得注意的是，我测试了BED格式，似乎不可以。</span></p>
<h3 class="md-end-block md-heading">输出数据及其复杂</h3>
<p><span class="md-line md-end-block">建议打印说明慢慢理解，争取熟记掌握。</span></p>
<p><span class="md-line md-end-block">snpEFF的输出文件说明书我就打印出来了。</span></p>
<p><span class="md-line md-end-block">非常重要。</span></p>
]]></content:encoded>
			<wfw:commentRss>http://www.bio-info-trainee.com/1600.html/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>用snpEFF对vcf格式的突变数据进行注释</title>
		<link>http://www.bio-info-trainee.com/1594.html</link>
		<comments>http://www.bio-info-trainee.com/1594.html#comments</comments>
		<pubDate>Thu, 05 May 2016 11:29:55 +0000</pubDate>
		<dc:creator><![CDATA[ulwvfje]]></dc:creator>
				<category><![CDATA[基础数据库]]></category>
		<category><![CDATA[基础软件]]></category>
		<category><![CDATA[未分类]]></category>
		<category><![CDATA[snpeff]]></category>
		<category><![CDATA[vcf]]></category>
		<category><![CDATA[突变]]></category>

		<guid isPermaLink="false">http://www.bio-info-trainee.com/?p=1594</guid>
		<description><![CDATA[这个软件比较重要，尤其是对做遗传变异相关研究的，很多人做完了snp-callin &#8230; <a href="http://www.bio-info-trainee.com/1594.html">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description>
				<content:encoded><![CDATA[<p>这个软件比较重要，尤其是对做遗传变异相关研究的，很多人做完了snp-calling后喜欢用ANNOVAR来进行注释，但是那个注释还是相对比较简单，只能得到该突变位点在基因的哪个区域，那个基因这样的信息，如果想了解更具体一点，就需要更加功能化的软件了，snpEFF就是其中的佼佼者，而且是java平台软件，非常容易使用！而且它的手册写的非常详细：<a href="http://snpeff.sourceforge.net/SnpEff_manual.html">http://snpeff.sourceforge.net/SnpEff_manual.html</a><span id="more-1594"></span></p>
<p>官网是：<a href="http://snpeff.sourceforge.net/">http://snpeff.sourceforge.net/</a></p>
<p>1       889455  .       G       A       .       .        ## 假设我们的vcf文件里面记录的突变是这个，那么我们可以用snpEFF进行注释，注释得到的信息非常完全！</p>
<p>信息用|符号分割，所有很容易用脚本提取需要的信息</p>
<p>ANN=A|stop_gained|HIGH|NOC2L|ENSG00000188976|transcript|ENST00000327044|protein_coding|7/19|c.706C&gt;T|p.Gln236*|756/2790|706/2250|236/749||,A|downstream_gene_variant|MODIFIER|NOC2L|ENSG00000188976|transcript|ENST00000487214|processed_transcript||n.*865C&gt;T|||||351|,A|downstream_gene_variant|MODIFIER|NOC2L|ENSG00000188976|transcript|ENST00000469563|retained_intron||n.*878C&gt;T|||||4171|,A|non_coding_exon_variant|<strong>MODIFIER</strong>|NOC2L|ENSG00000188976|transcript|ENST00000477976|retained_intron|5/17|n.2153C&gt;T||||||;LOF=(NOC2L|ENSG00000188976|6|0.17);NMD=(NOC2L|ENSG00000188976|6|0.17)</p>
<p>包括突变类型是：non_coding_exon_variant</p>
<p>突变在各种转录本上面，在每个转录本的第几个碱基呀，哪个氨基酸的改变呀，氨基酸第几位呀！</p>
<p>标准突变表示形式是：</p>
<p>突变发生在NOC2L这个基因上面，它的ensembl 数据库ID是ENSG00000188976</p>
<p>&nbsp;</p>
<p>其余的看头文件自己慢慢理解：</p>
<p>"Functional annotations: 'Allele | Annotation | Annotation_Impact | Gene_Name | Gene_ID | Feature_Type | Feature_ID | Transcript_BioType | Rank | HGVS.c | HGVS.p | cDNA.pos / cDNA.length | CDS.pos / CDS.length | AA.pos / AA.length | Distance | ERRORS / WARNINGS / INFO'</p>
<p>&nbsp;</p>
<h1><span style="color: #ff0000;">软件安装：</span></h1>
<p>选择最新版软件下载：<a href="https://sourceforge.net/projects/snpeff/files/">https://sourceforge.net/projects/snpeff/files/</a></p>
<p>wget <a href="https://sourceforge.net/projects/snpeff/files/snpEff_latest_core.zip">https://sourceforge.net/projects/snpeff/files/snpEff_latest_core.zip</a></p>
<p>因为是java软件，unzip 解压之后就可以直接使用，当然前提是你有java平台。</p>
<p><a href="http://www.bio-info-trainee.com/wp-content/uploads/2016/05/1.png"><img class="alignnone size-full wp-image-1597" src="http://www.bio-info-trainee.com/wp-content/uploads/2016/05/1.png" alt="1" width="368" height="178" /></a></p>
<h1><span style="color: #ff0000;">输入数据：</span></h1>
<p>首先下载用来做注释的数据库：java -jar snpEff.jar download GRCh37.75(自己选择需要的版本)</p>
<p><a href="http://www.bio-info-trainee.com/wp-content/uploads/2016/05/11.png"><img class="alignnone size-full wp-image-1598" src="http://www.bio-info-trainee.com/wp-content/uploads/2016/05/11.png" alt="1" width="370" height="176" /></a></p>
<p>软件下载很快，但是数据库下载就需要一定时间啦，去喝杯咖啡吧。</p>
<p>然后软件本身会提供example文件，里面就是一堆各种各样的vcf数据，而且还提供了运行命令，非常简单(examples.sh) ,这些就是我们的输入数据啦！</p>
<h1><span style="color: #ff0000;">运行命令：</span></h1>
<p>运行也很简单：java -Xmx4G -jar snpEff.jar -i vcf -o vcf GRCh37.75 example.vcf &gt; example_snpeff.vcf</p>
<p>指定输入输出格式都是vcf，然后指定刚才下载的必备数据库，然后输入输出文件即可！</p>
<p>也可以调用全路径，如果你写在脚本里面的话！</p>
<blockquote><p>java -Xmx4G -jar path/to/snpEff/snpEff.jar \</p>
<p>-c path/to/snpEff/snpEff.config \</p>
<p>GRCh37.69 \</p>
<p>path/to/example.vcf &gt; example_snpeff.vcf</p></blockquote>
<p>&nbsp;</p>
<h1><span style="color: #ff0000;">结果解读：</span></h1>
<p>这个非常复杂，对结果理解了多少，就是我们对软件理解了多少。</p>
<p>具体大家看readme吧，注释信息太多了，按需索取：</p>
<ol>
<li>chromosome_number_variation</li>
<li>exon_loss_variant</li>
<li>frameshift_variant</li>
<li>stop_gained</li>
<li>stop_lost</li>
<li>start_lost</li>
<li>splice_acceptor_variant</li>
<li>splice_donor_variant</li>
<li>rare_amino_acid_variant</li>
<li>missense_variant</li>
<li>inframe_insertion</li>
<li>disruptive_inframe_insertion</li>
<li>inframe_deletion</li>
<li>disruptive_inframe_deletion</li>
<li>5_prime_UTR_truncation+exon_loss_variant</li>
<li>3_prime_UTR_truncation+exon_loss</li>
<li>splice_branch_variant</li>
<li>splice_region_variant</li>
<li>splice_branch_variant</li>
<li>stop_retained_variant</li>
<li>initiator_codon_variant</li>
<li>synonymous_variant</li>
<li>initiator_codon_variant+non_canonical_start_codon</li>
<li>stop_retained_variant</li>
<li>coding_sequence_variant</li>
<li>5_prime_UTR_variant</li>
<li>3_prime_UTR_variant</li>
<li>5_prime_UTR_premature_start_codon_gain_variant</li>
<li>upstream_gene_variant</li>
<li>downstream_gene_variant</li>
<li>TF_binding_site_variant</li>
<li>regulatory_region_variant</li>
<li>miRNA</li>
<li>custom</li>
<li>sequence_feature</li>
<li>conserved_intron_variant</li>
<li>intron_variant</li>
<li>intragenic_variant</li>
<li>conserved_intergenic_variant</li>
<li>intergenic_region</li>
<li>coding_sequence_variant</li>
<li>non_coding_exon_variant</li>
<li>nc_transcript_variant</li>
<li>gene_variant</li>
<li>chromosome</li>
</ol>
<p><a href="http://snpeff.sourceforge.net/VCFannotationformat_v1.0.pdf">http://snpeff.sourceforge.net/VCFannotationformat_v1.0.pdf</a></p>
<p>&nbsp;</p>
]]></content:encoded>
			<wfw:commentRss>http://www.bio-info-trainee.com/1594.html/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>居然可以下载千人基因组计划的所有数据bam，vcf数据</title>
		<link>http://www.bio-info-trainee.com/1339.html</link>
		<comments>http://www.bio-info-trainee.com/1339.html#comments</comments>
		<pubDate>Thu, 14 Jan 2016 11:54:48 +0000</pubDate>
		<dc:creator><![CDATA[ulwvfje]]></dc:creator>
				<category><![CDATA[基础数据库]]></category>
		<category><![CDATA[vcf]]></category>
		<category><![CDATA[千人基因组]]></category>
		<category><![CDATA[基因型]]></category>

		<guid isPermaLink="false">http://www.bio-info-trainee.com/?p=1339</guid>
		<description><![CDATA[它有两个ftp站点存储所有的数据！ ftp://ftp.1000genomes. &#8230; <a href="http://www.bio-info-trainee.com/1339.html">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description>
				<content:encoded><![CDATA[<div>它有两个ftp站点存储所有的数据！</div>
<div><a href="ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/" target="_blank">ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/</a></div>
<div><a href="ftp://ftp.ncbi.nlm.nih.gov/1000genomes/ftp/">ftp://ftp.ncbi.nlm.nih.gov/1000genomes/ftp/</a></div>
<div>直接看最新版的数据，共有NA编号开头的1182个人，HG开头的1768个人！</div>
<div><a href="ftp://ftp.ncbi.nlm.nih.gov/1000genomes/ftp/phase3/data/">ftp://ftp.ncbi.nlm.nih.gov/1000genomes/ftp/phase3/data/</a></div>
<div>也可以按照人种来查看这些数据：<a href="ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/data_collections/1000_genomes_project/data/">ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/data_collections/1000_genomes_project/data/</a></div>
<div>每个人的目录下面都有 四个数据文件夹</div>
<div>Oct 01 2014 00:00    Directory alignment</div>
<div>Oct 01 2014 00:00    Directory exome_alignment</div>
<div>Oct 01 2014 00:00    Directory high_coverage_alignment</div>
<div>Oct 01 2014 00:00    Directory sequence_read</div>
<div>这些数据实在是太丰富了！</div>
<div>也可以直接看最新版的vcf文件，记录了这两千多人的所有变异位点信息！</div>
<div>可以直接看到所有的位点，具体到每个人在该位点是否变异！</div>
<div><a href="ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/release/20130502/">ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/release/20130502/</a></div>
<div></div>
<div>不过它的基因型信息是通过MVNcall+SHAPEIT这个程序call出来的，具体原理见：<a href="http://www.ncbi.nlm.nih.gov/pubmed/23093610">http://www.ncbi.nlm.nih.gov/pubmed/23093610</a></div>
<div>而且网站还提供一些教程：<a href="ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/data_collections/1000_genomes_project/working/">ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/data_collections/1000_genomes_project/working/</a></div>
<div>
<div>它有两个ftp站点存储所有的数据！</div>
<div><a href="ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/" target="_blank">ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/</a></div>
<div><a href="ftp://ftp.ncbi.nlm.nih.gov/1000genomes/ftp/">ftp://ftp.ncbi.nlm.nih.gov/1000genomes/ftp/</a></div>
<div>直接看最新版的数据，共有NA编号开头的1182个人，HG开头的1768个人！</div>
<div><a href="ftp://ftp.ncbi.nlm.nih.gov/1000genomes/ftp/phase3/data/">ftp://ftp.ncbi.nlm.nih.gov/1000genomes/ftp/phase3/data/</a></div>
<div>也可以按照人种来查看这些数据：<a href="ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/data_collections/1000_genomes_project/data/">ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/data_collections/1000_genomes_project/data/</a></div>
<div>每个人的目录下面都有 四个数据文件夹</div>
<div>Oct 01 2014 00:00    Directory alignment</div>
<div>Oct 01 2014 00:00    Directory exome_alignment</div>
<div>Oct 01 2014 00:00    Directory high_coverage_alignment</div>
<div>Oct 01 2014 00:00    Directory sequence_read</div>
<div>这些数据实在是太丰富了！</div>
<div>也可以直接看最新版的vcf文件，记录了这两千多人的所有变异位点信息！</div>
<div>可以直接看到所有的位点，具体到每个人在该位点是否变异！</div>
<div><a href="ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/release/20130502/">ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/release/20130502/</a></div>
<div></div>
<div>不过它的基因型信息是通过MVNcall+SHAPEIT这个程序call出来的，具体原理见：<a href="http://www.ncbi.nlm.nih.gov/pubmed/23093610">http://www.ncbi.nlm.nih.gov/pubmed/23093610</a></div>
<div>而且网站还提供一些教程：<a href="ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/data_collections/1000_genomes_project/working/">ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/data_collections/1000_genomes_project/working/</a></div>
<div><a href="http://www.bio-info-trainee.com/wp-content/uploads/2016/01/clipboard4.png"><img class="alignnone size-full wp-image-1341" src="http://www.bio-info-trainee.com/wp-content/uploads/2016/01/clipboard4.png" alt="clipboard" width="346" height="255" /></a></div>
<div>还有Illumina的450K甲基化芯片数据：<a href="ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/data_collections/hgsv_sv_discovery/working/20151214_450k_methylation/">ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/data_collections/hgsv_sv_discovery/working/20151214_450k_methylation/</a></div>
<div>还有一个小程序，<a href="ftp://ftp.ncbi.nlm.nih.gov/1000genomes/ftp/technical/browser/vcf_to_ped_converter/version_1.1/">ftp://ftp.ncbi.nlm.nih.gov/1000genomes/ftp/technical/browser/vcf_to_ped_converter/version_1.1/</a></div>
</div>
<div>还有Illumina的450K甲基化芯片数据：<a href="ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/data_collections/hgsv_sv_discovery/working/20151214_450k_methylation/">ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/data_collections/hgsv_sv_discovery/working/20151214_450k_methylation/</a></div>
<div>还有一个小程序，<a href="ftp://ftp.ncbi.nlm.nih.gov/1000genomes/ftp/technical/browser/vcf_to_ped_converter/version_1.1/">ftp://ftp.ncbi.nlm.nih.gov/1000genomes/ftp/technical/browser/vcf_to_ped_converter/version_1.1/</a></div>
<p>&nbsp;</p>
]]></content:encoded>
			<wfw:commentRss>http://www.bio-info-trainee.com/1339.html/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>使用oncotator做突变注释</title>
		<link>http://www.bio-info-trainee.com/1287.html</link>
		<comments>http://www.bio-info-trainee.com/1287.html#comments</comments>
		<pubDate>Tue, 05 Jan 2016 11:51:53 +0000</pubDate>
		<dc:creator><![CDATA[ulwvfje]]></dc:creator>
				<category><![CDATA[cancer]]></category>
		<category><![CDATA[maf]]></category>
		<category><![CDATA[oncotator]]></category>
		<category><![CDATA[vcf]]></category>
		<category><![CDATA[癌症]]></category>

		<guid isPermaLink="false">http://www.bio-info-trainee.com/?p=1287</guid>
		<description><![CDATA[功能：vcf格式突变数据进一步注释成maf格式 做过癌症数据分析的童鞋都知道，T &#8230; <a href="http://www.bio-info-trainee.com/1287.html">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description>
				<content:encoded><![CDATA[<div>功能：vcf格式突变数据进一步注释成maf格式</div>
<p>做过癌症数据分析的童鞋都知道，TCGA里面用maf格式来记录突变！那么maf格式的数据是如何得来的呢，我们都知道，做完snp-calling一般是得到vcf格式的突变记录数据文件，然后再用annovar或者其它蛋白结构功能影响预测软件注释一下，还远达不到maf的近100条记录。</p>
<div>而大名鼎鼎的broad institute就规定了maf格式的突变注释文件，他就是利用了十几个常见的已知数据库来注释我们得到的vcf突变记录，通常是对somatic的突变才注释成maf格式的数据！</div>
<div></div>
<div>
<div>大名鼎鼎的broadinstitute出品的突变注释工具：<a href="http://www.ncbi.nlm.nih.gov/pubmed/25703262">http://www.ncbi.nlm.nih.gov/pubmed/25703262</a></div>
<div>源码在github：<span class="Apple-converted-space"> </span><a href="https://github.com/broadinstitute/oncotator">https://github.com/broadinstitute/oncotator</a></div>
<div>软件官网是：<span class="Apple-converted-space"> </span><a href="https://www.broadinstitute.org/oncotator/">https://www.broadinstitute.org/oncotator/</a></div>
<div>说明书:<span class="Apple-converted-space"> </span><a href="http://gatkforums.broadinstitute.org/gatk/discussion/4154/howto-install-and-run-oncotator-for-the-first-time">http://gatkforums.broadinstitute.org/gatk/discussion/4154/howto-install-and-run-oncotator-for-the-first-time</a></div>
<div>需要提前自己下载14G的数据：<a href="http://www.broadinstitute.org/~lichtens/oncobeta/oncotator_v1_ds_Jan262015.tar.gz">http://www.broadinstitute.org/~lichtens/oncobeta/oncotator_v1_ds_Jan262015.tar.gz</a></div>
<div>软件可以在官网下载：<a href="https://github.com/broadinstitute/oncotator/archive/v1.8.0.0.tar.gz">https://github.com/broadinstitute/oncotator/archive/v1.8.0.0.tar.gz</a></div>
<div></div>
<div>本身也是一个在线工具：</div>
<div>input data数据指南：<a href="https://www.broadinstitute.org/oncotator/help/#inputformat">https://www.broadinstitute.org/oncotator/help/#inputformat</a></div>
<div>集成了下面所有的分析资源</div>
<div>而且还提供了API</div>
<div>
<h4>Genomic Annotations</h4>
<ul>
<li>Gene, transcript, and functional consequence annotations using <a href="http://www.gencodegenes.org/">GENCODE</a> for hg19.</li>
<li>Reference sequence around a variant.</li>
<li>GC content around a variant.</li>
<li>Human DNA Repair Gene annotations from <a href="http://sciencepark.mdanderson.org/labs/wood/DNA_Repair_Genes.html">Wood et al.</a></li>
</ul>
<h4>Protein Annotations</h4>
<ul>
<li>Site-specific protein annotations from <a href="http://www.uniprot.org/">UniProt</a>.</li>
<li>Functional impact predictions from <a href="https://sites.google.com/site/jpopgen/dbNSFP">dbNSFP</a>.</li>
</ul>
<h4>Cancer Variant Annotations</h4>
<ul>
<li>Observed cancer mutation frequency annotations from <a href="http://www.sanger.ac.uk/genetics/CGP/cosmic/">COSMIC</a>.</li>
<li>Cancer gene and mutation annotations from the <a href="http://www.sanger.ac.uk/genetics/CGP/Census/">Cancer GenCensus</a>.</li>
<li>Overlapping mutations from the <a href="http://www.broadinstitute.org/ccle/home">Cancer Cell Line Encyclopedia</a>.</li>
<li>Cancer gene annotations from the <a href="http://www.familialcancerdatabase.nl/">Familial Cancer Database</a>.</li>
<li>Cancer variant annotations from <a href="http://www.ncbi.nlm.nih.gov/clinvar/">ClinVar</a>.</li>
</ul>
<h4>Non-Cancer Variant Annotations</h4>
<ul>
<li>Common SNP annotations from <a href="http://www.ncbi.nlm.nih.gov/projects/SNP/">dbSNP</a>.</li>
<li>Variant annotations from <a href="http://www.1000genomes.org/data">1000 Genomes</a>.</li>
<li>Variant annotations from <a href="https://esp.gs.washington.edu/drupal/">NHLBI GO Exome Sequencing Project (ESP)</a>.</li>
</ul>
</div>
</div>
<div></div>
<div>因为要下载的数据有点多，我这里就不用自己的电脑测试了，安装过程也很简单的！</div>
<div></div>
<p>&nbsp;</p>
]]></content:encoded>
			<wfw:commentRss>http://www.bio-info-trainee.com/1287.html/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>转载-VCF格式详解</title>
		<link>http://www.bio-info-trainee.com/863.html</link>
		<comments>http://www.bio-info-trainee.com/863.html#comments</comments>
		<pubDate>Fri, 17 Jul 2015 03:16:57 +0000</pubDate>
		<dc:creator><![CDATA[ulwvfje]]></dc:creator>
				<category><![CDATA[生信基础]]></category>
		<category><![CDATA[vcf]]></category>
		<category><![CDATA[基础知识]]></category>
		<category><![CDATA[转载]]></category>

		<guid isPermaLink="false">http://www.bio-info-trainee.com/?p=863</guid>
		<description><![CDATA[CHROM(chromosome):染色体 POS - position:参考基 &#8230; <a href="http://www.bio-info-trainee.com/863.html">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description>
				<content:encoded><![CDATA[<p><strong>CHROM(</strong><strong>chromosome</strong><strong>):</strong>染色体</p>
<p><strong>POS - position:</strong>参考基因组variant碱基位置，如果是INDEL（插入缺失），位置是INDEL的第一个碱基位置</p>
<p><strong>ID - identifier: </strong>variant的ID。比如在dbSNP中有该SNP的id，则会在此行给出；若没有，则用’.'表示其为一个novel variant。</p>
<p><strong>REF - reference base(s):</strong>参考碱基，染色体上面的碱基，必须是ATCGN中的一个，N表示不确定碱基</p>
<p><strong>ALT - alternate base(s):</strong>与参考序列比较发生突变的碱基</p>
<p><strong>QUAL - quality:</strong> Phred格式(Phred_scaled)的质量值，表 示在该位点存在variant的可能性；该值越高，则variant的可能性越大；计算方法：Phred值 = -10 * log (1-p) p为variant存在的概率; 通过计算公式可以看出值为10的表示错误概率为0.1，该位点为variant的概率为90%。</p>
<p><strong>FILTER - _filter status:</strong> 使用上一个QUAL值来进行过滤的话，是不够的。GATK能使用其它的方法来进行过滤，过滤结果中通过则该值为”PASS”;若variant不可靠，则该项不为”PASS”或”.”。</p>
<p><strong>INFO - additional information:</strong>  这一行是variant的详细信息，具体如下：</p>
<p><strong>DP-</strong>read depth：样本在这个位置的reads覆盖度。是一些reads被过滤掉后的覆盖度。          DP4:高质量测序碱基，位于REF或者ALT前后</p>
<p><strong>MQ</strong>：表示覆盖序列质量的均方值RMS Mapping Quality</p>
<p><strong>FQ</strong><strong>：</strong>phred值关于所有样本相似的可能性</p>
<p><strong>AF1</strong><strong>：</strong> AF(Allele Frequency) 表示Allele的频率，AF1为第一个ALT allele 发生频率的可能性评估</p>
<p><strong>AC1</strong><strong>：</strong>AC表示Allele（等位基因）的数目,AC1为对第一个ALT allele count的最大可能性评估</p>
<p><strong>AN</strong>：AN(Allele Number) 表示Allele的总数目</p>
<p><strong>IS</strong><strong>：</strong>插入缺失或部分插入缺失的reads允许的最大数量</p>
<p><strong>AC</strong><strong>：</strong>AC(Allele Count) 表示该Allele的数目</p>
<p><strong>G3</strong><strong>：</strong>ML 评估基因型出现的频率</p>
<p><strong>HWE</strong>：chi^2基于HWE的测试p值和G3</p>
<p><strong>CLR</strong><strong>：</strong>在受到或者不受限制的情况下基因型出现可能性log值</p>
<p><strong>UGT</strong>：最可能不受限制的三种基因型结构</p>
<p><strong>CGT</strong>：最可能受限制三种基因型的结构</p>
<p><strong>PV4</strong><strong>：</strong>四种P值得误差，分别是（strand、baseQ、mapQ、tail distance bias）</p>
<p><strong>INDEL</strong>：表示该位置的变异是插入缺失</p>
<p><strong>PC2</strong><strong>：</strong>非参考等位基因的phred（变异的可能性）值在两个分组中大小不同</p>
<p><strong>PCHI2</strong><strong>：</strong>后加权chi^2，根据p值来测试两组样本之间的联系</p>
<p><strong>QCHI2</strong>：Phred scaled PCHI2.</p>
<p><strong>PR</strong><strong>：</strong>置换产生的一个较小的PCHI2</p>
<p><strong>QBD</strong>：Quality by Depth，测序深度对质量的影响</p>
<p><strong>RPB</strong><strong>：</strong>序列的误差位置（Read Position Bias）</p>
<p><strong>MDV</strong>：样本中高质量非参考序列的最大数目</p>
<p><strong>VDB</strong>：Variant Distance Bias，RNA序列中过滤人工拼接序列的变异误差范围</p>
<p><strong>GT</strong><strong>：</strong>样品的基因型（genotype）。两个数字中间用’/'分 开，这两个数字表示双倍体的sample的基因型。0 表示样品中有ref的allele； 1 表示样品中variant的allele； 2表示有第二个variant的allele。因此： 0/0 表示sample中该位点为纯合的，和ref一致； 0/1 表示sample中该位点为杂合的，有ref和variant两个基因型； 1/1 表示sample中该位点为纯合的，和variant一致。</p>
<p><strong>GQ</strong><strong>：</strong>基因型的质量值(Genotype Quality)。Phred格式(Phred_scaled)的质量值，表示在该位点该基因型存在的可能性；该值越高，则Genotype的可能性越 大；计算方法：Phred值 = -10 * log (1-p) p为基因型存在的概率。</p>
<p><strong>GL</strong><strong>：</strong>三种基因型（RR RA AA）出现的可能性，R表示参考碱基，A表示变异碱基</p>
<p><strong>DV</strong><strong>：</strong>高质量的非参考碱基</p>
<p><strong>SP</strong><strong>：</strong>phred的p值误差线</p>
<p><strong>PL</strong>：指定的三种基因型的质量值(provieds the likelihoods of the given genotypes)。这三种指定的基因型为(0/0,0/1,1/1)，这三种基因型的概率总和为1。和之前不一致，该值越大，表明为该种基因型的可能 性越小。 Phred值 = -10 * log (p) p为基因型存在的概率。</p>
<p><strong>FORMAT </strong><strong>和</strong><strong> BC1-1-base.sorted.bam</strong><strong>：</strong>这两行合起来提供了’ BC1-1-base′这个sample的基因型的信息。’ BC1-1-base′代表这该名称的样品，是由BAM文件中的@RG下的 SM 标签决定的。</p>
]]></content:encoded>
			<wfw:commentRss>http://www.bio-info-trainee.com/863.html/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>
