Bowtie(下载)是一个超级快速的,较为节省内存的短序列拼接至模板基因组的工具。它在拼接35碱基长度的序列时,可以达到每小时2.5亿次的拼接速度。Bowtie并不是一个简单的拼接工具,它不同于Blast等。它适合的工作是将小序列比对至大基因组上去。它最长能读取1024个碱基的片段。换言之,bowtie非常适合下一代测序技术。
在使用bowtie前,需要使用bowtie-build来构建比对模板。如果你需要比对是比较常见的基因组的话,你可以去下载你所需要的Pre-built indexes文件就可以了。如你要想建立human chr1的索引,可采用下列命令:-bash-3.2$ ./bowtie-build genomes/hg19/chr1.fa chr1 ,结果会生存chr1.1.ebwt chr1.2.ebwt chr1.3.ebwt chr1.4.ebwt四个索引文件,然后把这四个文件移到程序所在文件夹的indexes文件夹中就可以了,如果你机器的内存不够4G,建议不要做整个基因的索引,可每条染色体做一个。如果你没有基因组序列,也可使用软件自带的程序(./scripts/make_hg19.sh)建立索引。
如前所述,bowtie适合于将短序列拼接至大的模板上,尤其是基因组。模板最小尺寸不能小于1024碱基,而短序列最长而不能超过1024碱基。 Bowtie设计思路是,1)短序列在基因组上至少有一处最适匹配, 2)大部分的短序列的质量是比较高,3)短序列在基因组上最适匹配的位置最好只有一处。这些标准基本上和RNA-seq, ChIP-seq以及其它一些正在兴起的测序技术或者再测序技术的要求一致。
如果bowtie在你的机器上运行起来很慢,那么你可以试试以下的一些办法来让它跑得快一些:
尽可能的使用64位bowtie。很显然,64位运算会比32位运算更快。所以最好使用支持64位运算的计算机来运行64位的bowtie。如果你是从原文件开始编译程序,在g++编译时,你需要传递-m64参数,你也可以在make的时候加入这一信息,比如说传递BITS=64给make,具体的:make BITS=64 bowtie。想知道你自己运算的是什么版本的bowtie,你可以运行bowtie –version
如果你的计算机有多个CPU或者CPU内核,那么请使用-p参数。-p参数会让bowtie进入多线程模式。每一个线程都会使用单独的CPU或者CPU内核。这种并行的运算模式也会大大加快运算速度。
如果你的报告文件中每条短序列都有太多的匹配位点(超过10)那么你可以试着重新使用bowtie-build加上 –offrate参数,如bowtie-build –offrate 4。-o/–offrate默认值为5,每下降1,比对速度会增加1倍,但是系统消耗(硬盘空间和内存)也会加倍。
如果你的系统配置太低,比如内存不足4GB,那么建议你在bowtie的时候使用–offrate参数。与上一条相反的,你需要加大 offrate的值。bowtie –offrate 6. 其默认值为5。每增加1,内存空间的要求下降,这样会减少读取硬盘当中虚拟内存的次数,速度反而会有所上升。
-n模式与-v模式。
默认的,bowtie采用了和Maq一样的质量控制策略,设置 -n 2 -l 28 -e 70。总的来说,比对模式分为两种,一种是 -n 模式, 一种是 -v 模式,而且这两种模式是不能同时使用的。bowtie默认使用-n模式。
-n模式参数: -n N -l L -e E
其中N,L,E都为整数。-n N 代表在高保真区内错配不能超过N个,可以是0?3,一般的设置为2。-l L代表序列高保真区的长度,最短不能少于5,对于短序列长度为32的,设置为28就很不错。-e E代表在错配位点Phred quality值不能超过E,默认值为40。Phred quality值的计算式为:-10 log(P,base(10))
Phred Quality值 错配可能性 正配可能性
10 1/10 90%
20 1/100 99%
30 1/1000 99.9%
40 1/10000 99.99%
50 1/100000 99.999%
而-v模式的参数相对较少。
-v模式参数:-v V
其中V为整数。-v V代表全长错配不能超过V个,可以是0?3。这时,不考虑是否高保真区,也不考虑Phred quality值。
–best 与–strata
–best参数代表报告文件中,每个短序列的匹配结果将按匹配质量由高到低排序。–strata参数必须与–best参数一起使用,其作用是只报告质量最高的那部分。所谓质量高低,其实就是指错配的碱基数,如果指定了-l L参数,那就是在高保真区内的错配数,否则就是全序列的错配数。如果你还指定了 -M X的话,那就会在质量最高的当中,随机选择X个来报告。也就是说,当我们指定了-M 1 –best –strata的话,那就只报告1个最好的。
对于输入,-q是指输入的文件为FASTQ(文件扩展名通常为.fq或者.fastq)格式;-f是指输入文件为FASTA(文件扩展名通常为.fa, .mfa或者.fna)格式;-c是指在命令行直接输入要比对的序列。
下面就是一个具体的例子:
./bowtie -v 2 -M 1 –best –strata Genomes/hg19_ebwt/hg19 Pol2ChIP.fastq Pol2ChIP.map
./bowtie -S -t -p 8 -q –chunkmbs 128 hg18_combined.fa.bowtie -1 Pair1.fastq -2 Pair2.fastq bowpeout.sam
./bowtie -S -t -p 8 -q -I 0 -X 300 –chunkmbs 128 hg18_combined.fa.bowtie -1 Pair1.fastq -2 Pair2.fastq bowpeout.sam
time bowtie -p 2 -v 2 -k 11 -m 10 -t –strata –best hg19.index -1 sample_10M_1.fastq -2 sample_10M_2.fastq sample.bowtie_aln.txt
./bowtie-p 5 -m 10 -f trx -1 mate1.fa -2 mate2.fa >output
附带Bowtie使用手册:
What is Bowtie?
===============
[Bowtie] is an ultrafast, memory-efficient short read aligner geared
toward quickly aligning large sets of short DNA sequences (reads) to
large genomes. It aligns 35-base-pair reads to the human genome at a
rate of 25 million reads per hour on a typical workstation. Bowtie
indexes the genome with a [Burrows-Wheeler] index to keep its memory
footprint small: for the human genome, the index is typically about
2.2 GB (for unpaired alignment) or 2.9 GB (for paired-end or colorspace
alignment). Multiple processors can be used simultaneously to achieve
greater alignment speed. Bowtie can also output alignments in the
standard [SAM] format, allowing Bowtie to interoperate with other tools
supporting SAM, including the [SAMtools] consensus, SNP, and indel
callers. Bowtie runs on the command line under Windows, Mac OS X,
Linux, and Solaris.
[Bowtie] also forms the basis for other tools, including [TopHat]: a
fast splice junction mapper for RNA-seq reads, [Cufflinks]: a tool for
transcriptome assembly and isoform quantitiation from RNA-seq reads,
[Crossbow]: a cloud-computing software tool for large-scale
resequencing data,and [Myrna]: a cloud computing tool for calculating
differential gene expression in large RNA-seq datasets.
If you use [Bowtie] for your published research, please cite the
[Bowtie paper].
[Bowtie]: http://bowtie-bio.sf.net
[Burrows-Wheeler]: http://en.wikipedia.org/wiki/Burrows-Wheeler_transform
[SAM]: http://samtools.sourceforge.net/SAM1.pdf
[SAMtools]: http://samtools.sourceforge.net/
[TopHat]: http://tophat.cbcb.umd.edu/
[Cufflinks]: http://cufflinks.cbcb.umd.edu/
[Crossbow]: http://bowtie-bio.sf.net/crossbow
[Myrna]: http://bowtie-bio.sf.net/myrna
[Bowtie paper]: http://genomebiology.com/2009/10/3/R25
What isn't Bowtie?
==================
Bowtie is not a general-purpose alignment tool like [MUMmer], [BLAST]
or [Vmatch]. Bowtie works best when aligning short reads to large
genomes, though it supports arbitrarily small reference sequences (e.g.
amplicons) and reads as long as 1024 bases. Bowtie is designed to be
extremely fast for sets of short reads where (a) many of the reads have
at least one good, valid alignment, (b) many of the reads are
relatively high-quality, and (c) the number of alignments reported per
read is small (close to 1).
Bowtie does not yet report gapped alignments; this is future work.
[MUMmer]: http://mummer.sourceforge.net/
[BLAST]: http://blast.ncbi.nlm.nih.gov/Blast.cgi
[Vmatch]: http://www.vmatch.de/
Obtaining Bowtie
================
You may download either Bowtie sources or binaries for your platform
from the [Download] section of the Sourceforge project site. Binaries
are currently available for Intel architectures (`i386` and `x86_64`)
running Linux, Windows, and Mac OS X.
Building from source
--------------------
Building Bowtie from source requires a GNU-like environment that
includes GCC, GNU Make and other basics. It should be possible to
build Bowtie on a vanilla Linux or Mac installation. Bowtie can also
be built on Windows using [Cygwin] or [MinGW]. We recommend
[TDM's MinGW Build]. If using [MinGW], you must also have [MSYS]
installed.
To build Bowtie, extract the sources, change to the extracted
directory, and run GNU `make` (usually with the command `make`, but
sometimes with `gmake`) with no arguments. If building with [MinGW],
run `make` from the [MSYS] command line.
To support the `-p` (multithreading) option, Bowtie needs the
`pthreads` library. To compile Bowtie without `pthreads` (which
disables `-p`), use `make BOWTIE_PTHREADS=0`.
[Cygwin]: http://www.cygwin.com/
[MinGW]: http://www.mingw.org/
[TDM's MinGW Build]: http://www.tdragon.net/recentgcc/
[MSYS]: http://www.mingw.org/wiki/msys
[Download]: https://sourceforge.net/projects/bowtie-bio/files/bowtie/
The `bowtie` aligner
====================
`bowtie` takes an index and a set of reads as input and outputs a list
of alignments. Alignments are selected according to a combination of
the `-v`/`-n`/`-e`/`-l` options (plus the `-I`/`-X`/`--fr`/`--rf`/
`--ff` options for paired-end alignment), which define which alignments
are legal, and the `-k`/`-a`/`-m`/`-M`/`--best`/`--strata` options
which define which and how many legal alignments should be reported.
By default, Bowtie enforces an alignment policy similar to [Maq]'s
default quality-aware policy (`-n` 2 `-l` 28 `-e` 70). See [the -n
alignment mode] section of the manual for details about this mode. But
Bowtie can also enforce a simpler end-to-end k-difference policy (e.g.
with `-v` 2). See [the -v alignment mode] section of the manual for
details about that mode. [The -n alignment mode] and [the -v alignment
mode] are mutually exclusive.
Bowtie works best when aligning short reads to large genomes (e.g.
human or mouse), though it supports arbitrarily small reference
sequences and reads as long as 1024 bases. Bowtie is designed to be
very fast for sets of short reads where a) many reads have at least one
good, valid alignment, b) many reads are relatively high-quality, c)
the number of alignments reported per read is small (close to 1).
These criteria are generally satisfied in the context of modern
short-read analyses such as RNA-seq, ChIP-seq, other types of -seq, and
mammalian resequencing. You may observe longer running times in other
research contexts.
If `bowtie` is too slow for your application, try some of the
performance-tuning hints described in the [Performance Tuning] section
below.
Alignments involving one or more ambiguous reference characters (`N`,
`-`, `R`, `Y`, etc.) are considered invalid by Bowtie. This is true
only for ambiguous characters in the reference; alignments involving
ambiguous characters in the read are legal, subject to the alignment
policy. Ambiguous characters in the read mismatch all other
characters. Alignments that "fall off" the reference sequence are not
considered valid.
The process by which `bowtie` chooses an alignment to report is
randomized in order to avoid "mapping bias" - the phenomenon whereby
an aligner systematically fails to report a particular class of good
alignments, causing spurious "holes" in the comparative assembly.
Whenever `bowtie` reports a subset of the valid alignments that exist,
it makes an effort to sample them randomly. This randomness flows
from a simple seeded pseudo-random number generator and is
deterministic in the sense that Bowtie will always produce the same
results for the same read when run with the same initial "seed" value
(see `--seed` option).
In the default mode, `bowtie` can exhibit strand bias. Strand bias
occurs when input reference and reads are such that (a) some reads
align equally well to sites on the forward and reverse strands of the
reference, and (b) the number of such sites on one strand is different
from the number on the other strand. When this happens for a given
read, `bowtie` effectively chooses one strand or the other with 50%
probability, then reports a randomly-selected alignment for that read
from among the sites on the selected strand. This tends to overassign
alignments to the sites on the strand with fewer sites and underassign
to sites on the strand with more sites. The effect is mitigated,
though it may not be eliminated, when reads are longer or when
paired-end reads are used. Running Bowtie in `--best` mode
eliminates strand bias by forcing Bowtie to select one strand or the
other with a probability that is proportional to the number of best
sites on the strand.
Gapped alignments are not currently supported, but support is planned
for a future release.
[Maq]: http://maq.sf.net
The `-n` alignment mode
-----------------------
When the `-n` option is specified (which is the default), `bowtie`
determines which alignments are valid according to the following
policy, which is similar to [Maq]'s default policy.
1. Alignments may have no more than `N` mismatches (where `N` is a
number 0-3, set with `-n`) in the first `L` bases (where `L` is a
number 5 or greater, set with `-l`) on the high-quality (left) end
of the read. The first `L` bases are called the "seed".
2. The sum of the [Phred quality] values at *all* mismatched positions
(not just in the seed) may not exceed `E` (set with `-e`). Where
qualities are unavailable (e.g. if the reads are from a FASTA
file), the [Phred quality] defaults to 40.
The `-n` option is mutually exclusive with the `-v` option.
If there are many possible alignments satisfying these criteria, Bowtie
gives preference to alignments with fewer mismatches and where the sum
from criterion 2 is smaller. When the `--best` option is specified,
Bowtie guarantees the reported alignment(s) are "best" in terms of
these criteria (criterion 1 has priority), and that the alignments are
reported in best-to-worst order. Bowtie is somewhat slower when
`--best` is specified.
Note that [Maq] internally rounds base qualities to the nearest 10 and
rounds qualities greater than 30 to 30. To maintain compatibility,
Bowtie does the same. Rounding can be suppressed with the
`--nomaqround` option.
Bowtie is not fully sensitive in `-n` 2 and `-n` 3 modes by default.
In these modes Bowtie imposes a "backtracking limit" to limit effort
spent trying to find valid alignments for low-quality reads unlikely to
have any. This may cause bowtie to miss some legal 2- and 3-mismatch
alignments. The limit is set to a reasonable default (125 without
`--best`, 800 with `--best`), but the user may decrease or increase the
limit using the `--maxbts` and/or `-y` options. `-y` mode is
relatively slow but guarantees full sensitivity.
[Maq]: http://maq.sf.net
[Phred quality]: http://en.wikipedia.org/wiki/FASTQ_format#Variations
The `-v` alignment mode
-----------------------
In `-v` mode, alignments may have no more than `V` mismatches, where
`V` may be a number from 0 through 3 set using the `-v` option.
Quality values are ignored. The `-v` option is mutually exclusive with
the `-n` option.
If there are many legal alignments, Bowtie gives preference to
alignments with fewer mismatches. When the `--best` option is
specified, Bowtie guarantees the reported alignment(s) are "best" in
terms of the number of mismatches, and that the alignments are reported
in best-to-worst order. Bowtie is somewhat slower when `--best` is
specified.
Strata
------
In [the -n alignment mode], an alignment's "stratum" is defined as the
number of mismatches in the "seed" region, i.e. the leftmost `L` bases,
where `L` is set with the `-l` option. In [the -v alignment mode], an
alignment's stratum is defined as the total number of mismatches in the
entire alignment. Some of Bowtie's options (e.g. `--strata` and `-m`
use the notion of "stratum" to limit or expand the scope of reportable
alignments.
Reporting Modes
---------------
With the `-k`, `-a`, `-m`, `-M`, `--best` and `--strata` options, the
user can flexibily select which alignments are reported. Below we
demonstrate a few ways in which these options can be combined. All
examples are using the `e_coli` index packaged with Bowtie. The
`--suppress` option is used to keep the output concise and some
output is elided for clarity.
Example 1: `-a`
$ ./bowtie -a -v 2 e_coli --suppress 1,5,6,7 -c ATGCATCATGCGCCAT
- gi|110640213|ref|NC_008253.1| 148810 10:A>G,13:C>G
- gi|110640213|ref|NC_008253.1| 2852852 8:T>A
- gi|110640213|ref|NC_008253.1| 4930433 4:G>T,6:C>G
- gi|110640213|ref|NC_008253.1| 905664 6:A>G,7:G>T
+ gi|110640213|ref|NC_008253.1| 1093035 2:T>G,15:A>T
Specifying `-a` instructs bowtie to report *all* valid alignments,
subject to the alignment policy: `-v` 2. In this case, bowtie finds
5 inexact hits in the E. coli genome; 1 hit (the 2nd one listed)
has 1 mismatch, and the other 4 hits have 2 mismatches. Four are on
the reverse reference strand and one is on the forward strand. Note
that they are not listed in best-to-worst order.
Example 2: `-k 3`
$ ./bowtie -k 3 -v 2 e_coli --suppress 1,5,6,7 -c ATGCATCATGCGCCAT
- gi|110640213|ref|NC_008253.1| 148810 10:A>G,13:C>G
- gi|110640213|ref|NC_008253.1| 2852852 8:T>A
- gi|110640213|ref|NC_008253.1| 4930433 4:G>T,6:C>G
Specifying `-k` 3 instructs bowtie to report up to 3 valid
alignments. In this case, a total of 5 valid alignments exist (see
[Example 1]); `bowtie` reports 3 out of those 5. `-k` can be set to
any integer greater than 0.
Example 3: `-k 6`
$ ./bowtie -k 6 -v 2 e_coli --suppress 1,5,6,7 -c ATGCATCATGCGCCAT
- gi|110640213|ref|NC_008253.1| 148810 10:A>G,13:C>G
- gi|110640213|ref|NC_008253.1| 2852852 8:T>A
- gi|110640213|ref|NC_008253.1| 4930433 4:G>T,6:C>G
- gi|110640213|ref|NC_008253.1| 905664 6:A>G,7:G>T
+ gi|110640213|ref|NC_008253.1| 1093035 2:T>G,15:A>T
Specifying `-k` 6 instructs bowtie to report up to 6 valid
alignments. In this case, a total of 5 valid alignments exist, so
`bowtie` reports all 5.
Example 4: default (`-k 1`)
$ ./bowtie -v 2 e_coli --suppress 1,5,6,7 -c ATGCATCATGCGCCAT
- gi|110640213|ref|NC_008253.1| 148810 10:A>G,13:C>G
Leaving the reporting options at their defaults causes `bowtie` to
report the first valid alignment it encounters. Because `--best` was
not specified, we are not guaranteed that bowtie will report the best
alignment, and in this case it does not (the 1-mismatch alignment from
the previous example would have been better). The default reporting
mode is equivalent to `-k` 1.
Example 5: `-a --best`
$ ./bowtie -a --best -v 2 e_coli --suppress 1,5,6,7 -c ATGCATCATGCGCCAT
- gi|110640213|ref|NC_008253.1| 2852852 8:T>A
+ gi|110640213|ref|NC_008253.1| 1093035 2:T>G,15:A>T
- gi|110640213|ref|NC_008253.1| 905664 6:A>G,7:G>T
- gi|110640213|ref|NC_008253.1| 148810 10:A>G,13:C>G
- gi|110640213|ref|NC_008253.1| 4930433 4:G>T,6:C>G
Specifying `-a` `--best` results in the same alignments being printed
as if just `-a` had been specified, but they are guaranteed to be
reported in best-to-worst order.
Example 6: `-a --best --strata`
$ ./bowtie -a --best --strata -v 2 --suppress 1,5,6,7 e_coli -c ATGCATCATGCGCCAT
- gi|110640213|ref|NC_008253.1| 2852852 8:T>A
Specifying `--strata` in addition to `-a` and `--best` causes
`bowtie` to report only those alignments in the best alignment
"stratum". The alignments in the best stratum are those having the
least number of mismatches (or mismatches just in the "seed" portion of
the alignment in the case of `-n` mode). Note that if `--strata`
is specified, `--best` must also be specified.
Example 7: `-a -m 3`
$ ./bowtie -a -m 3 -v 2 e_coli -c ATGCATCATGCGCCAT
No alignments
Specifying `-m` 3 instructs bowtie to refrain from reporting any
alignments for reads having more than 3 reportable alignments. The
`-m` option is useful when the user would like to guarantee that
reported alignments are "unique", for some definition of unique.
Example 1 showed that the read has 5 reportable alignments when `-a`
and `-v` 2 are specified, so the `-m` 3 limit causes bowtie to
output no alignments.
Example 8: `-a -m 5`
$ ./bowtie -a -m 5 -v 2 e_coli --suppress 1,5,6,7 -c ATGCATCATGCGCCAT
- gi|110640213|ref|NC_008253.1| 148810 10:A>G,13:C>G
- gi|110640213|ref|NC_008253.1| 2852852 8:T>A
- gi|110640213|ref|NC_008253.1| 4930433 4:G>T,6:C>G
- gi|110640213|ref|NC_008253.1| 905664 6:A>G,7:G>T
+ gi|110640213|ref|NC_008253.1| 1093035 2:T>G,15:A>T
Specifying `-m` 5 instructs bowtie to refrain from reporting any
alignments for reads having more than 5 reportable alignments. Since
the read has exactly 5 reportable alignments, the `-m` 5 limit allows
`bowtie` to print them as usual.
Example 9: `-a -m 3 --best --strata`
$ ./bowtie -a -m 3 --best --strata -v 2 e_coli --suppress 1,5,6,7 -c ATGCATCATGCGCCAT
- gi|110640213|ref|NC_008253.1| 2852852 8:T>A
Specifying `-m` 3 instructs bowtie to refrain from reporting any
alignments for reads having more than 3 reportable alignments. As we
saw in Example 6, the read has only 1 reportable alignment when `-a`,
`--best` and `--strata` are specified, so the `-m` 3 limit allows
`bowtie` to print that alignment as usual.
Intuitively, the `-m` option, when combined with the `--best` and
`--strata` options, guarantees a principled, though weaker form of
"uniqueness." A stronger form of uniqueness is enforced when `-m` is
specified but `--best` and `--strata` are not.
Paired-end Alignment
--------------------
`bowtie` can align paired-end reads when properly paired read files are
specified using the `-1` and `-2` options (for pairs of raw, FASTA, or
FASTQ read files), or using the `--12` option (for Tab-delimited read
files). A valid paired-end alignment satisfies these criteria:
1. Both mates have a valid alignment according to the alignment policy
defined by the `-v`/`-n`/`-e`/`-l` options.
2. The relative orientation and position of the mates satisfy the
constraints defined by the `-I`/`-X`/`--fr`/`--rf`/`--ff`
options.
Policies governing which paired-end alignments are reported for a
given read are specified using the `-k`, `-a` and `-m` options as
usual. The `--strata` and `--best` options do not apply in
paired-end mode.
A paired-end alignment is reported as a pair of mate alignments, both
on a separate line, where the alignment for each mate is formatted the
same as an unpaired (singleton) alignment. The alignment for the mate
that occurs closest to the beginning of the reference sequence (the
"upstream" mate) is always printed before the alignment for the
downstream mate. Reads files containing paired-end reads will
sometimes name the reads according to whether they are the #1 or #2
mates by appending a `/1` or `/2` suffix to the read name. If no such
suffix is present in Bowtie's input, the suffix will be added when
Bowtie prints read names in alignments (except in `-S` "SAM" mode,
where mate information is encoded in the `FLAGS` field instead).
Finding a valid paired-end alignment where both mates align to
repetitive regions of the reference can be very time-consuming. By
default, Bowtie avoids much of this cost by imposing a limit on the
number of "tries" it makes to match an alignment for one mate with a
nearby alignment for the other. The default limit is 100. This causes
`bowtie` to miss some valid paired-end alignments where both mates lie
in repetitive regions, but the user may use the `--pairtries` or
`-y` options to increase Bowtie's sensitivity as desired.
Paired-end alignments where one mate's alignment is entirely contained
within the other's are considered invalid.
When colospace alignment is enabled via `-C`, the default setting for
paired-end orientation is `--ff`. This is because most SOLiD datasets
have that orientation. When colorspace alignment is not enabled
(default), the default setting for orientation is `--fr`, since most
Illumina datasets have this orientation. The default can be overriden
in either case.
Because Bowtie uses an in-memory representation of the original
reference string when finding paired-end alignments, its memory
footprint is larger when aligning paired-end reads. For example, the
human index has a memory footprint of about 2.2 GB in single-end mode
and 2.9 GB in paired-end mode. Note that paired-end and unpaired
alignment incur the same memory footprint in colorspace (e.g. human
incurs about 2.9 GB)
Colorspace Alignment
--------------------
As of version 0.12.0, `bowtie` can align colorspace reads against a
colorspace index when `-C` is specified. Colorspace is the
characteristic output format of Applied Biosystems' SOLiD system. In a
colorspace read, each character is a color rather than a nucleotide,
where a color encodes a class of dinucleotides. E.g. the color blue
encodes any of the dinucleotides: AA, CC, GG, TT. Colorspace has the
advantage of (often) being able to distinguish sequencing errors from
SNPs once the read has been aligned. See ABI's [Principles of Di-Base
Sequencing] document for details.
Colorspace reads
All input formats (FASTA `-f`, FASTQ `-q`, raw `-r`, tab-delimited
`--12`, command-line `-c`) are compatible with colorspace (`-C`).
When `-C` is specified, read sequences are treated as colors. Colors
may be encoded either as numbers (`0`=blue, `1`=green, `2`=orange,
`3`=red) or as characters `A/C/G/T` (`A`=blue, `C`=green, `G`=orange,
`T`=red).
Some reads include a primer base as the first character; e.g.:
>1_53_33_F3
T2213120002010301233221223311331
>1_53_70_F3
T2302111203131231130300111123220
...
Here, `T` is the primer base. `bowtie` detects and handles primer
bases properly (i.e., the primer base and the adjacent color are both
trimmed away prior to alignment) as long as the rest of the read is
encoded as numbers.
`bowtie` also handles input in the form of parallel `.csfasta` and
`_QV.qual` files. Use `-f` to specify the `.csfasta` files and `-Q`
(for unpaired reads) or `--Q1`/`--Q2` (for paired-end reads) to
specify the corresponding `_QV.qual` files. It is not necessary to
first convert to FASTQ, though `bowtie` also handles FASTQ-formatted
colorspace reads (with `-q`, the default).
Building a colorspace index
A colorspace index is built in the same way as a normal index except
that `-C` must be specified when running `bowtie-build`. If the user
attempts to use `bowtie` without `-C` to align against an index that
was built with `-C` (or vice versa), `bowtie` prints an error message
and quits.
Decoding colorspace alignments
Once a colorspace read is aligned, Bowtie decodes the alignment into
nucleotides and reports the decoded nucleotide sequence. A principled
decoding scheme is necessary because many different possible decodings
are usually possible. Finding the true decoding with 100% certainty
requires knowing all variants (e.g. SNPs) in the subject's genome
beforehand, which is usually not possible. Instead, `bowtie` employs
the approximate decoding scheme described in the [BWA paper]. This
scheme attempts to distinguish variants from sequencing errors
according to their relative likelihood under a model that considers the
quality values of the colors and the (configurable) global likelihood
of a SNP.
Quality values are also "decoded" so that each reported quality value
is a function of the two color qualities overlapping it. Bowtie again
adopts the scheme described in the [BWA paper], i.e., the decoded
nucleotide quality is either the sum of the overlapping color qualities
(when both overlapping colors correspond to bases that match in the
alignment), the quality of the matching color minus the quality of the
mismatching color, or 0 (when both overlapping colors correspond to
mismatches).
For accurate decoding, `--snpphred`/`--snpfrac` should be set according
to the user's best guess of the SNP frequency in the subject. The
`--snpphred` parameter sets the SNP penalty directly (on the [Phred
quality] scale), whereas `--snpfrac` allows the user to specify the
fraction of sites expected to be SNPs; the fraction is then converted
to a [Phred quality] internally. For the purpose of decoding, the SNP
fraction is defined in terms of SNPs per *haplotype* base. Thus, if
the genome is diploid, heterozygous SNPs have half the weight of
homozygous SNPs
Note that in `-S`/`--sam` mode, the decoded nucleotide sequence is
printed for alignments, but the original color sequence (with `A`=blue,
`C`=green, `G`=orange, `T`=red) is printed for unaligned reads without
any reported alignments. As always, the `--un`, `--max` and `--al`
parameters print reads exactly as they appeared in the input file.
Paired-end colorspace alignment
Like other platforms, SOLiD supports generation of paired-end reads.
When colorspace alignment is enabled, the default paired-end
orientation setting is `--ff`. This is because most SOLiD datasets
have that orientation.
Note that SOLiD-generated read files can have "orphaned" mates; i.e.
mates without a correpsondingly-named mate in the other file. To avoid
problems due to orphaned mates, SOLiD paired-end output should first be
converted to `.csfastq` files with unpaired mates omitted. This can be
accomplished using, for example, [Galaxy]'s conversion tool (click
"NGS: QC and manipulation", then "SOLiD-to-FASTQ" in the left-hand
sidebar).
[Principles of Di-Base Sequencing]: http://tinyurl.com/ygnb2gn
[BWA paper]: http://bioinformatics.oxfordjournals.org/cgi/content/abstract/25/14/1754
Performance Tuning
------------------
1. Use 64-bit bowtie if possible
The 64-bit version of Bowtie is substantially (usually more then
50%) faster than the 32-bit version, owing to its use of 64-bit
arithmetic. If possible, download the 64-bit binaries for Bowtie
and run on a 64-bit computer. If you are building Bowtie from
sources, you may need to pass the `-m64` option to `g++` to compile
the 64-bit version; you can do this by including `BITS=64` in the
arguments to the `make` command; e.g.: `make BITS=64 bowtie`. To
determine whether your version of bowtie is 64-bit or 32-bit, run
`bowtie --version`.
2. If your computer has multiple processors/cores, use `-p`
The `-p` option causes Bowtie to launch a specified number of
parallel search threads. Each thread runs on a different
processor/core and all threads find alignments in parallel,
increasing alignment throughput by approximately a multiple of the
number of threads (though in practice, speedup is somewhat worse
than linear).
3. If reporting many alignments per read, try tweaking
`bowtie-build --offrate`
If you are using the `-k`, `-a` or `-m` options and Bowtie is
reporting many alignments per read (an average of more than about
10 per read) and you have some memory to spare, using an index with
a denser SA sample can speed things up considerably.
To do this, specify a smaller-than-default `-o`/`--offrate` value
when running `bowtie-build`. A denser SA sample yields a larger
index, but is also particularly effective at speeding up alignment
when many alignments are reported per read. For example,
decreasing the index's `-o`/`--offrate` by 1 could as much as
double alignment performance, and decreasing by 2 could quadruple
alignment performance, etc.
On the other hand, decreasing `-o`/`--offrate` increases the size
of the Bowtie index, both on disk and in memory when aligning
reads. At the default `-o`/`--offrate` of 5, the SA sample for the
human genome occupies about 375 MB of memory when aligning reads.
Decreasing the `-o`/`--offrate` by 1 doubles the memory taken by
the SA sample, and decreasing by 2 quadruples the memory taken,
etc.
4. If bowtie "thrashes", try increasing `bowtie --offrate`
If `bowtie` runs very slow on a relatively low-memory machine
(having less than about 4 GB of memory), then try setting `bowtie`
`-o`/`--offrate` to a *larger* value than the value used to build
the index. For example, `bowtie-build`'s default `-o`/`--offrate`
is 5 and all pre-built indexes available from the Bowtie website
are built with `-o`/`--offrate` 5; so if `bowtie` thrashes when
querying such an index, try using `bowtie` `--offrate` 6. If
`bowtie` still thrashes, try `bowtie` `--offrate` 7, etc. A higher
`-o`/`--offrate` causes `bowtie` to use a sparser sample of the
suffix array than is stored in the index; this saves memory but
makes alignment reporting slower (which is especially slow when
using `-a` or large `-k` or `-m`).
Command Line
------------
Usage:
bowtie [options]* } [
Main arguments
The basename of the index to be searched. The basename is the name of
any of the index files up to but not including the final `.1.ebwt` /
`.rev.1.ebwt` / etc. `bowtie` looks for the specified index first in
the current directory, then in the `indexes` subdirectory under the
directory where the `bowtie` executable is located, then looks in the
directory specified in the `BOWTIE_INDEXES` environment variable.
Comma-separated list of files containing the #1 mates (filename usually
includes `_1`), or, if `-c` is specified, the mate sequences
themselves. E.g., this might be `flyA_1.fq,flyB_1.fq`, or, if `-c`
is specified, this might be `GGTCATCCT,ACGGGTCGT`. Sequences specified
with this option must correspond file-for-file and read-for-read with
those specified in `
If `-` is specified, `bowtie` will read the #1 mates from the "standard
in" filehandle.
Comma-separated list of files containing the #2 mates (filename usually
includes `_2`), or, if `-c` is specified, the mate sequences
themselves. E.g., this might be `flyA_2.fq,flyB_2.fq`, or, if `-c`
is specified, this might be `GGTCATCCT,ACGGGTCGT`. Sequences specified
with this option must correspond file-for-file and read-for-read with
those specified in `
If `-` is specified, `bowtie` will read the #2 mates from the "standard
in" filehandle.
Comma-separated list of files containing a mix of unpaired and
paired-end reads in Tab-delimited format. Tab-delimited format is a
1-read-per-line format where unpaired reads consist of a read name,
sequence and quality string each separated by tabs. A paired-end read
consists of a read name, sequnce of the #1 mate, quality values of the
#1 mate, sequence of the #2 mate, and quality values of the #2 mate
separated by tabs. Quality values can be expressed using any of the
scales supported in FASTQ files. Reads may be a mix of different
lengths and paired-end and unpaired reads may be intermingled in the
same file. If `-` is specified, `bowtie` will read the Tab-delimited
reads from the "standard in" filehandle.
A comma-separated list of files containing unpaired reads to be
aligned, or, if `-c` is specified, the unpaired read sequences
themselves. E.g., this might be
`lane1.fq,lane2.fq,lane3.fq,lane4.fq`, or, if `-c` is specified, this
might be `GGTCATCCT,ACGGGTCGT`. Reads may be a mix of different
lengths. If `-` is specified, Bowtie gets the reads from the "standard
in" filehandle.
File to write alignments to. By default, alignments are written to the
"standard out" filehandle (i.e. the console).
Options
Input
-q
The query input files (specified either as `
``) are FASTQ files (usually having extension `.fq` or `.fastq`).
This is the default. See also: `--solexa-quals` and
`--integer-quals`.
-f
The query input files (specified either as `
``) are FASTA files (usually having extension `.fa`, `.mfa`, `.fna`
or similar). All quality values are assumed to be 40 on the [Phred
quality] scale.
-r
The query input files (specified either as `
``) are Raw files: one sequence per line, without quality values or
names. All quality values are assumed to be 40 on the [Phred quality]
scale.
-c
The query sequences are given on command line. I.e. `
`
read files.
-C/--color
Align in colorspace. Read characters are interpreted as colors. The
index specified must be a colorspace index (i.e. built with
`bowtie-build` `-C`, or `bowtie` will print an error message and quit.
See [Colorspace alignment] for more details.
-Q/--quals
Comma-separated list of files containing quality values for
corresponding unpaired CSFASTA reads. Use in combination with `-C`
and `-f`. `--integer-quals` is set automatically when `-Q`/`--quals`
is specified.
--Q1
Comma-separated list of files containing quality values for
corresponding CSFASTA #1 mates. Use in combination with `-C`, `-f`,
and `-1`. `--integer-quals` is set automatically when `--Q1`
is specified.
--Q2
Comma-separated list of files containing quality values for
corresponding CSFASTA #2 mates. Use in combination with `-C`, `-f`,
and `-2`. `--integer-quals` is set automatically when `--Q2`
is specified.
-s/--skip
Skip (i.e. do not align) the first `
-u/--qupto
Only align the first `
the `-s`/`--skip` reads or pairs have been skipped). Default: no
limit.
-5/--trim5
Trim `
alignment (default: 0).
-3/--trim3
Trim `
alignment (default: 0).
--phred33-quals
Input qualities are ASCII chars equal to the [Phred quality] plus 33.
Default: on.
--phred64-quals
Input qualities are ASCII chars equal to the [Phred quality] plus 64.
Default: off.
--solexa-quals
Convert input qualities from [Solexa][Phred quality] (which can be
negative) to [Phred][Phred quality] (which can't). This is usually the
right option for use with (unconverted) reads emitted by GA Pipeline
versions prior to 1.3. Default: off.
--solexa1.3-quals
Same as `--phred64-quals`. This is usually the right option for use
with (unconverted) reads emitted by GA Pipeline version 1.3 or later.
Default: off.
--integer-quals
Quality values are represented in the read input file as
space-separated ASCII integers, e.g., `40 40 30 40`..., rather than
ASCII characters, e.g., `II?I`.... Integers are treated as being on
the [Phred quality] scale unless `--solexa-quals` is also specified.
Default: off.
Alignment
-v
Report alignments with at most `
options are ignored and quality values have no effect on what
alignments are valid. `-v` is mutually exclusive with `-n`.
-n/--seedmms
Maximum number of mismatches permitted in the "seed", i.e. the first
`L` base pairs of the read (where `L` is set with `-l`/`--seedlen`).
This may be 0, 1, 2 or 3 and the default is 2. This option is mutually
exclusive with the `-v` option.
-e/--maqerr
Maximum permitted total of quality values at *all* mismatched read
positions throughout the entire alignment, not just in the "seed". The
default is 70. Like [Maq], `bowtie` rounds quality values to the
nearest 10 and saturates at 30; rounding can be disabled with
`--nomaqround`.
-l/--seedlen
The "seed length"; i.e., the number of bases on the high-quality end of
the read to which the `-n` ceiling applies. The lowest permitted
setting is 5 and the default is 28. `bowtie` is faster for larger
values of `-l`.
--nomaqround
[Maq] accepts quality values in the [Phred quality] scale, but
internally rounds values to the nearest 10, with a maximum of 30. By
default, `bowtie` also rounds this way. `--nomaqround` prevents this
rounding in `bowtie`.
-I/--minins
The minimum insert size for valid paired-end alignments. E.g. if `-I
60` is specified and a paired-end alignment consists of two 20-bp
alignments in the appropriate orientation with a 20-bp gap between
them, that alignment is considered valid (as long as `-X` is also
satisfied). A 19-bp gap would not be valid in that case. If trimming
options `-3` or `-5` are also used, the `-I` constraint is
applied with respect to the untrimmed mates. Default: 0.
-X/--maxins
The maximum insert size for valid paired-end alignments. E.g. if `-X
100` is specified and a paired-end alignment consists of two 20-bp
alignments in the proper orientation with a 60-bp gap between them,
that alignment is considered valid (as long as `-I` is also
satisfied). A 61-bp gap would not be valid in that case. If trimming
options `-3` or `-5` are also used, the `-X` constraint is applied
with respect to the untrimmed mates, not the trimmed mates. Default:
250.
--fr/--rf/--ff
The upstream/downstream mate orientations for a valid paired-end
alignment against the forward reference strand. E.g., if `--fr` is
specified and there is a candidate paired-end alignment where mate1
appears upstream of the reverse complement of mate2 and the insert
length constraints are met, that alignment is valid. Also, if mate2
appears upstream of the reverse complement of mate1 and all other
constraints are met, that too is valid. `--rf` likewise requires that
an upstream mate1 be reverse-complemented and a downstream mate2 be
forward-oriented. ` --ff` requires both an upstream mate1 and a
downstream mate2 to be forward-oriented. Default: `--fr` when `-C`
(colorspace alignment) is not specified, `--ff` when `-C` is specified.
--nofw/--norc
If `--nofw` is specified, `bowtie` will not attempt to align against
the forward reference strand. If `--norc` is specified, `bowtie` will
not attempt to align against the reverse-complement reference strand.
For paired-end reads using `--fr` or `--rf` modes, `--nofw` and
`--norc` apply to the forward and reverse-complement pair orientations.
I.e. specifying `--nofw` and `--fr` will only find reads in the R/F
orientation where mate 2 occurs upstream of mate 1 with respect to the
forward reference strand.
--maxbts
The maximum number of backtracks permitted when aligning a read in
`-n` 2 or `-n` 3 mode (default: 125 without `--best`, 800 with
`--best`). A "backtrack" is the introduction of a speculative
substitution into the alignment. Without this limit, the default
parameters will sometimes require that `bowtie` try 100s or 1,000s of
backtracks to align a read, especially if the read has many low-quality
bases and/or has no valid alignments, slowing bowtie down
significantly. However, this limit may cause some valid alignments to
be missed. Higher limits yield greater sensitivity at the expensive of
longer running times. See also: `-y`/`--tryhard`.
--pairtries
For paired-end alignment, this is the maximum number of attempts
`bowtie` will make to match an alignment for one mate up with an
alignment for the opposite mate. Most paired-end alignments require
only a few such attempts, but pairs where both mates occur in highly
repetitive regions of the reference can require significantly more.
Setting this to a higher number allows `bowtie` to find more paired-
end alignments for repetitive pairs at the expense of speed. The
default is 100. See also: `-y`/`--tryhard`.
-y/--tryhard
Try as hard as possible to find valid alignments when they exist,
including paired-end alignments. This is equivalent to specifying very
high values for the `--maxbts` and `--pairtries` options. This
mode is generally much slower than the default settings, but can be
useful for certain problems. This mode is slower when (a) the
reference is very repetitive, (b) the reads are low quality, or (c) not
many reads have valid alignments.
--chunkmbs
The number of megabytes of memory a given thread is given to store path
descriptors in `--best` mode. Best-first search must keep track of
many paths at once to ensure it is always extending the path with the
lowest cumulative cost. Bowtie tries to minimize the memory impact of
the descriptors, but they can still grow very large in some cases. If
you receive an error message saying that chunk memory has been
exhausted in `--best` mode, try adjusting this parameter up to
dedicate more memory to the descriptors. Default: 64.
Reporting
-k
Report up to `
Validity of alignments is determined by the alignment policy (combined
effects of `-n`, `-v`, `-l`, and `-e`). If more than one valid
alignment exists and the `--best` and `--strata` options are
specified, then only those alignments belonging to the best alignment
"stratum" will be reported. Bowtie is designed to be very fast for
small `-k` but bowtie can become significantly slower as `-k`
increases. If you would like to use Bowtie for larger values of
`-k`, consider building an index with a denser suffix-array sample,
i.e. specify a smaller `-o`/`--offrate` when invoking `bowtie-build`
for the relevant index (see the [Performance tuning] section for
details).
-a/--all
Report all valid alignments per read or pair (default: off). Validity
of alignments is determined by the alignment policy (combined effects
of `-n`, `-v`, `-l`, and `-e`). If more than one valid alignment
exists and the `--best` and `--strata` options are specified, then only
those alignments belonging to the best alignment "stratum" will be
reported. Bowtie is designed to be very fast for small `-k` but bowtie
can become significantly slower if `-a`/`--all` is specified. If you
would like to use Bowtie with `-a`, consider building an index with a
denser suffix-array sample, i.e. specify a smaller `-o`/`--offrate`
when invoking `bowtie-build` for the relevant index (see the
[Performance tuning] section for details).
-m
Suppress all alignments for a particular read or pair if more than
`
those that would be reported given the `-n`, `-v`, `-l`, `-e`, `-k`,
`-a`, `--best`, and `--strata` options. Default: no limit. Bowtie is
designed to be very fast for small `-m` but bowtie can become
significantly slower for larger values of `-m`. If you would like to
use Bowtie for larger values of `-k`, consider building an index with a
denser suffix-array sample, i.e. specify a smaller `-o`/`--offrate` when
invoking `bowtie-build` for the relevant index (see the [Performance
tuning] section for details).
-M
Behaves like `-m` except that if a read has more than `
reportable alignments, one is reported at random. In [default
output mode], the selected alignment's 7th column is set to `
indicate the read has at least `
`-S`/`--sam` mode, the selected alignment is given a `MAPQ` (mapping
quality) of 0 and the `XM:I` field is set to `
requires `--best`; if specified without `--best`, `--best` is enabled
automatically.
--best
Make Bowtie guarantee that reported singleton alignments are "best" in
terms of stratum (i.e. number of mismatches, or mismatches in the seed
in the case of `-n` mode) and in terms of the quality values at the
mismatched position(s). Stratum always trumps quality; e.g. a
1-mismatch alignment where the mismatched position has [Phred quality]
40 is preferred over a 2-mismatch alignment where the mismatched
positions both have [Phred quality] 10. When `--best` is not
specified, Bowtie may report alignments that are sub-optimal in terms
of stratum and/or quality (though an effort is made to report the best
alignment). `--best` mode also removes all strand bias. Note that
`--best` does not affect which alignments are considered "valid" by
`bowtie`, only which valid alignments are reported by `bowtie`. When
`--best` is specified and multiple hits are allowed (via `-k` or
`-a`), the alignments for a given read are guaranteed to appear in
best-to-worst order in `bowtie`'s output. `bowtie` is somewhat slower
when `--best` is specified.
--strata
If many valid alignments exist and are reportable (e.g. are not
disallowed via the `-k` option) and they fall into more than one
alignment "stratum", report only those alignments that fall into the
best stratum. By default, Bowtie reports all reportable alignments
regardless of whether they fall into multiple strata. When
`--strata` is specified, `--best` must also be specified.
Output
-t/--time
Print the amount of wall-clock time taken by each phase.
-B/--offbase
When outputting alignments, number the first base of a reference
sequence as `
--quiet
Print nothing besides alignments.
--refout
Write alignments to a set of files named `refXXXXX.map`, where `XXXXX`
is the 0-padded index of the reference sequence aligned to. This can
be a useful way to break up work for downstream analyses when dealing
with, for example, large numbers of reads aligned to the assembled
human genome. If `
--refidx
When a reference sequence is referred to in a reported alignment, refer
to it by 0-based index (its offset into the list of references that
were indexed) rather than by name.
--al
Write all reads for which at least one alignment was reported to a file
with name `
input, without any of the trimming or translation of quality values
that may have taken place within `bowtie`. Paired-end reads will be
written to two parallel files with `_1` and `_2` inserted in the
filename, e.g., if `
that fail to align will be written to `aligned_1.fq` and `aligned_2.fq`
respectively.
--un
Write all reads that could not be aligned to a file with name
`
without any of the trimming or translation of quality values that may
have taken place within Bowtie. Paired-end reads will be written to
two parallel files with `_1` and `_2` inserted in the filename, e.g.,
if `
align will be written to `unaligned_1.fq` and `unaligned_2.fq`
respectively. Unless `--max` is also specified, reads with a number
of valid alignments exceeding the limit set with the `-m` option are
also written to `
--max
Write all reads with a number of valid alignments exceeding the limit
set with the `-m` option to a file with name `
reads will appear as they did in the input, without any of the trimming
or translation of quality values that may have taken place within
`bowtie`. Paired-end reads will be written to two parallel files with
`_1` and `_2` inserted in the filename, e.g., if `
`max.fq`, the #1 and #2 mates that exceed the `-m` limit will be
written to `max_1.fq` and `max_2.fq` respectively. These reads are not
written to the file specified with `--un`.
--suppress Suppress columns of output in the [default output mode]. E.g. if --fullref Print the full refernce sequence name, including whitespace, in Colorspace --snpphred When decoding colorspace alignments, use ` --snpfrac When decoding colorspace alignments, use ` --col-cseq If reads are in colorspace and the [default output mode] is active, --col-cqual If reads are in colorspace and the [default output mode] is active, --col-keepends When decoding colorpsace alignments, `bowtie` trims off a nucleotide SAM -S/--sam Print alignments in [SAM] format. See the [SAM output] section of the --mapq If an alignment is non-repetitive (according to `-m`, `--strata` and --sam-nohead Suppress header lines (starting with `@`) when output is `-S`/`--sam`. --sam-nosq Suppress `@SQ` header lines when output is `-S`/`--sam`. This must be --sam-RG Add ` Performance -o/--offrate Override the offrate of the index with ` -p/--threads Launch ` --mm Use memory-mapped I/O to load the index, rather than normal C file I/O. --shmem Use shared memory to load the index, rather than normal C file I/O. Other --seed Use ` --verbose Print verbose output (for debugging). --version Print version information and quit. -h/--help Print usage information and quit. Default `bowtie` output `bowtie` outputs one alignment per line. Each line is a collection of 1. Name of read that aligned 2. Reference strand aligned to, `+` for forward strand, `-` for 3. Name of reference sequence where alignment occurs, or numeric ID if 4. 0-based offset into the forward reference strand where leftmost 5. Read sequence (reverse-complemented if orientation is `-`). If the read was in colorspace, then the sequence shown in this 6. ASCII-encoded read qualities (reversed if orientation is `-`). The If the read was in colorspace, then the qualities shown in this 7. If `-M` was specified and the prescribed ceiling was exceeded for Otherwise, this column contains the number of other instances where 8. Comma-separated list of mismatch descriptors. If there are no SAM `bowtie` output Following is a brief description of the [SAM] format as output by When `-S`/`--sam` is specified, `bowtie` prints a SAM header with Each subsequnt line corresponds to a read or an alignment. Each line 1. Name of read that aligned 2. Sum of all applicable flags. Flags relevant to Bowtie are: 1 The read is one of a pair 2 The alignment is one end of a proper paired-end alignment 4 The read has no reported alignments 8 The read is one of a pair and has no reported alignments 16 The alignment is to the reverse reference strand 32 The other mate in the paired-end alignment is aligned to the 64 The read is the first mate in a pair 128 The read is the second mate in a pair Thus, an unpaired read that aligns to the reverse reference strand 3. Name of reference sequence where alignment occurs, or ordinal ID 4. 1-based offset into the forward reference strand where leftmost 5. Mapping quality 6. CIGAR string representation of alignment 7. Name of reference sequence where mate's alignment occurs. Set to 8. 1-based offset into the forward reference strand where leftmost 9. Inferred insert size. Size is negative if the mate's alignment 10. Read sequence (reverse-complemented if aligned to the reverse 11. ASCII-encoded read qualities (reverse-complemented if the read 12. Optional fields. Fields are tab-separated. For descriptions of NM:i: Aligned read has an edit distance of ` CM:i: Aligned read has an edit distance of ` MD:Z: For aligned reads, ` XA:i: Aligned read belongs to stratum ` XM:i: For a read with no reported alignments, ` [SAM format specification]: http://samtools.sf.net/SAM1.pdf The `bowtie-build` indexer `bowtie-build` builds a Bowtie index from a set of DNA sequences. Use of Karkkainen's [blockwise algorithm] allows `bowtie-build` to The indexer provides options pertaining to the "shape" of the index, Because `bowtie-build` uses 32-bit pointers internally, it can handle If your computer has more than 3-4 GB of memory and you would like to The Bowtie index is based on the [FM Index] of Ferragina and Manzini, [Blockwise algorithm]: http://portal.acm.org/citation.cfm?id=1314852 Command Line Usage: bowtie-build [options]* Main arguments A comma-separated list of FASTA files containing the reference The basename of the index files to write. By default, `bowtie-build` Options -f The reference input files (specified as ` -c The reference sequences are given on the command line. I.e. -C/--color Build a colorspace index, to be queried using `bowtie` `-C`. -a/--noauto Disable the default behavior whereby `bowtie-build` automatically -p/--packed Use a packed (2-bits-per-nucleotide) representation for DNA strings. --bmax The maximum number of suffixes allowed in a block. Allowing more --bmaxdivn The maximum number of suffixes allowed in a block, expressed as a --dcv Use ` --nodc Disable use of the difference-cover sample. Suffix sorting becomes -r/--noref Do not build the `NAME.3.ebwt` and `NAME.4.ebwt` portions of the index, -3/--justref Build *only* the `NAME.3.ebwt` and `NAME.4.ebwt` portions of the index, -o/--offrate To map alignments back to positions on the reference sequences, it's -t/--ftabchars The ftab is the lookup table used to calculate an initial --ntoa Convert Ns in the reference sequence to As before building the index. --big --little Endianness to use when serializing integers to the index file. --seed Use ` --cutoff Index only the first ` -q/--quiet `bowtie-build` is verbose by default. With this option `bowtie-build` -h/--help Print usage information and quit. --version Print version information and quit. The `bowtie-inspect` index inspector `bowtie-inspect` extracts information from a Bowtie index about what Command Line Usage: bowtie-inspect [options]* Main arguments The basename of the index to be inspected. The basename is name of any Options -a/--across When printing FASTA output, output a newline character every ` -n/--names Print reference sequence names, one per line, and quit. -s/--summary Print a summary that includes information about index settings, as well Colorspace <0 or 1> Fields are separated by tabs. -e/--ebwt-ref By default, when `bowtie-inspect` is run without `-s` or `-n`, it -v/--verbose Print verbose output (for debugging). --version Print version information and quit. -h/--help Print usage information and quit.
`--suppress 1,5,6` is specified, the read name, read sequence, and read
quality fields will be omitted. See [Default Bowtie output] for field
descriptions. This option is ignored if the output mode is
`-S`/`--sam`.
alignment output. By default `bowtie` prints everything up to but not
including the first whitespace.
This should be set to the user's best guess of the true ratio of SNPs
per base in the subject genome, converted to the [Phred quality] scale.
E.g., if the user expects about 1 SNP every 1,000 positions,
`--snpphred` should be set to 30 (which is also the default). To
specify the fraction directly, use `--snpfrac`.
of SNPs per base. For best decoding results, this should be set to the
user's best guess of the true ratio. `bowtie` internally converts the
ratio to a [Phred quality], and behaves as if that quality had been set
via the `--snpphred` option. Default: 0.001.
`--col-cseq` causes the reads' color sequence to appear in the
read-sequence column (column 5) instead of the decoded nucleotide
sequence. See the [Decoding colorspace alignments] section for details
about decoding. This option is ignored in `-S`/`--sam` mode.
`--col-cqual` causes the reads' original (color) quality sequence to
appear in the quality column (column 6) instead of the decoded
qualities. See the [Colorspace alignment] section for details about
decoding. This option is ignored in `-S`/`--sam` mode.
and quality from the left and right edges of the alignment. This is
because those nucleotides are supported by only one color, in contrast
to the middle nucleotides which are supported by two. Specify
`--col-keepends` to keep the extreme-end nucleotides and qualities.
manual for details. To suppress all SAM headers, use `--sam-nohead`
in addition to `-S/--sam`. To suppress just the `@SQ` headers (e.g. if
the alignment is against a very large number of reference sequences),
use `--sam-nosq` in addition to `-S/--sam`. `bowtie` does not write
BAM files directly, but SAM output can be converted to BAM on the fly
by piping `bowtie`'s output to `samtools view`. `-S`/`--sam` is not
compatible with `--refout`.
other options) set the `MAPQ` (mapping quality) field to this value.
See the [SAM Spec][SAM] for details about the `MAPQ` field Default: 255.
This must be specified *in addition to* `-S`/`--sam`. `--sam-nohead`
is ignored unless `-S`/`--sam` is also specified.
specified *in addition to* `-S`/`--sam`. `--sam-nosq` is ignored
unless `-S`/`--sam` is also specified.
field on the `@RG` header line. Specify `--sam-RG` multiple times to
set multiple fields. See the [SAM Spec][SAM] for details about what fields
are legal. Note that, if any `@RG` fields are set using this option,
the `ID` and `SM` fields must both be among them to make the `@RG` line
legal according to the [SAM Spec][SAM]. `--sam-RG` is ignored unless
`-S`/`--sam` is also specified.
than the offrate used to build the index, then some row markings are
discarded when the index is read into memory. This reduces the memory
footprint of the aligner but requires more time to calculate text
offsets. `
index.
on separate processors/cores and synchronize when parsing reads and
outputting alignments. Searching for alignments is highly parallel,
and speedup is fairly close to linear. This option is only available
if `bowtie` is linked with the `pthreads` library (i.e. if
`BOWTIE_PTHREADS=0` is not specified at build time).
Memory-mapping the index allows many concurrent `bowtie` processes on
the same computer to share the same memory image of the index (i.e. you
pay the memory overhead just once). This facilitates memory-efficient
parallelization of `bowtie` in situations where using `-p` is not
possible.
Using shared memory allows many concurrent bowtie processes on the same
computer to share the same memory image of the index (i.e. you pay the
memory overhead just once). This facilitates memory-efficient
parallelization of `bowtie` in situations where using `-p` is not
desirable. Unlike `--mm`, `--shmem` installs the index into shared
memory permanently, or until the user deletes the shared memory chunks
manually. See your operating system documentation for details on how
to manually list and remove shared memory chunks (on Linux and Mac OS
X, these commands are `ipcs` and `ipcrm`). You may also need to
increase your OS's maximum shared-memory chunk size to accomodate
larger indexes; see your OS documentation.
-----------------------
8 fields separated by tabs; from left to right, the fields are:
reverse
no name was provided
character of the alignment occurs
column is the sequence of *decoded nucleotides*, not the original
colors. See the [Colorspace alignment] section for details about
decoding. To display colors instead, use the `--col-cseq` option.
encoded quality values are on the Phred scale and the encoding is
ASCII-offset by 33 (ASCII char `!`).
column are the *decoded qualities*, not the original qualities.
See the [Colorspace alignment] section for details about decoding.
To display colors instead, use the `--col-cqual` option.
this read, this column contains the value of the ceiling,
indicating that at least that many valid alignments were found in
addition to the one reported.
the same sequence aligned against the same reference characters as
were aligned against in the reported alignment. This is *not* the
number of other places the read aligns with the same number of
mismatches. The number in this column is generally not a good
proxy for that number (e.g., the number in this column may be '0'
while the number of other alignments with the same number of
mismatches might be large).
mismatches in the alignment, this field is empty. A single
descriptor has the format offset:reference-base>read-base. The
offset is expressed as a 0-based offset from the high-quality (5')
end of the read.
-------------------
`bowtie` when the `-S`/`--sam` option is specified. For more
details, see the [SAM format specification][SAM].
`@HD`, `@SQ` and `@PG` lines. When one or more `--sam-RG` arguments
are specified, `bowtie` will also print an `@RG` line that includes all
user-specified `--sam-RG` tokens separated by tabs.
is a collection of at least 12 fields separated by tabs; from left to
right, the fields are:
reverse reference strand
will have flag 16. A paired-end read that aligns and is the first
mate in the pair will have flag 83 (= 64 + 16 + 2 + 1).
if no name was provided
character of the alignment occurs
`=` if the mate's reference sequence is the same as this
alignment's, or `*` if there is no mate.
character of the mate's alignment occurs. Offset is 0 if there is
no mate.
occurs upstream of this alignment. Size is 0 if there is no mate.
strand)
aligned to the reverse strand). The encoded quality values are on
the [Phred quality] scale and the encoding is ASCII-offset by 33
(ASCII char `!`), similarly to a [FASTQ] file.
all possible optional fields, see the SAM format specification.
`bowtie` outputs some of these optional fields for each alignment,
depending on the type of the alignment:
field is present in addition to the `NM` field in `-C`/`--color`
mode, but is omitted otherwise.` is a string representation of the
mismatched reference bases in the alignment. See [SAM] format
specification for details. For colorspace alignments, ``
describes the decoded *nucleotide* alignment, not the colorspace
alignment.
no alignments. If `-m` was specified and the read's alignments
were supressed because the `-m` ceiling was exceeded, `
the `-m` ceiling + 1, to indicate that there were at least that
many valid alignments (but all were suppressed). In `-M` mode, if
the alignment was randomly selected because the `-M` ceiling was
exceeded, `
were at least that many valid alignments (of which one was reported
at random).
[FASTQ]: http://en.wikipedia.org/wiki/FASTQ_format
==========================
`bowtie-build` outputs a set of 6 files with suffixes
`.1.ebwt`, `.2.ebwt`, `.3.ebwt`, `.4.ebwt`, `.rev.1.ebwt`, and
`.rev.2.ebwt`. These files together constitute the index: they are all
that is needed to align reads to that reference. The original sequence
files are no longer used by Bowtie once the index is built.
trade off between running time and memory usage. `bowtie-build` has
three options governing how it makes this trade: `-p`/`--packed`,
`--bmax`/`--bmaxdivn`, and `--dcv`. By default, `bowtie-build` will
automatically search for the settings that yield the best
running time without exhausting memory. This behavior can be disabled
using the `-a`/`--noauto` option.
e.g. `--offrate` governs the fraction of [Burrows-Wheeler] rows that
are "marked" (i.e., the density of the suffix-array sample; see the
original [FM Index] paper for details). All of these options are
potentially profitable trade-offs depending on the application. They
have been set to defaults that are reasonable for most cases according
to our experiments. See [Performance Tuning] for details.
up to a theoretical maximum of 2^32-1 (somewhat more than 4 billion)
characters in an index, though, with other constraints, the actual
ceiling is somewhat less than that. If your reference exceeds 2^32-1
characters, `bowtie-build` will print an error message and abort. To
resolve this, divide your reference sequences into smaller batches
and/or chunks and build a separate index for each.
exploit that fact to make index building faster, use a 64-bit version
of the `bowtie-build` binary. The 32-bit version of the binary is
restricted to using less than 4 GB of memory. If a 64-bit pre-built
binary does not yet exist for your platform on the sourceforge download
site, you will need to build one from source.
which in turn is based on the [Burrows-Wheeler] transform. The
algorithm used to build the index is based on the [blockwise algorithm]
of Karkkainen.
[FM Index]: http://portal.acm.org/citation.cfm?id=796543
[Burrows-Wheeler]: http://en.wikipedia.org/wiki/Burrows-Wheeler_transform
------------
sequences to be aligned to, or, if `-c` is specified, the sequences
themselves. E.g., `
`chr1.fa,chr2.fa,chrX.fa,chrY.fa`, or, if `-c` is specified, this might
be `GGTCATCCT,ACGGGTCGT,CCGTTCTATGCGGCTTA`.
writes files named `NAME.1.ebwt`, `NAME.2.ebwt`, `NAME.3.ebwt`,
`NAME.4.ebwt`, `NAME.rev.1.ebwt`, and `NAME.rev.2.ebwt`, where `NAME`
is `
files (usually having extension `.fa`, `.mfa`, `.fna` or similar).
`
list of FASTA files.
selects values for the `--bmax`, `--dcv` and `--packed` parameters
according to available memory. Instead, user may specify values for
those parameters. If memory is exhausted during indexing, an error
message will be printed; it is up to the user to try new parameters.
This saves memory but makes indexing 2-3 times slower. Default: off.
This is configured automatically by default; use `-a`/`--noauto` to
configure manually.
suffixes per block makes indexing faster, but increases peak memory
usage. Setting this option overrides any previous setting for
`--bmax`, or `--bmaxdivn`. Default (in terms of the `--bmaxdivn`
parameter) is `--bmaxdivn` 4. This is configured automatically by
default; use `-a`/`--noauto` to configure manually.
fraction of the length of the reference. Setting this option overrides
any previous setting for `--bmax`, or `--bmaxdivn`. Default:
`--bmaxdivn` 4. This is configured automatically by default; use
`-a`/`--noauto` to configure manually.
period yields less memory overhead, but may make suffix sorting slower,
especially if repeats are present. Must be a power of 2 no greater
than 4096. Default: 1024. This is configured automatically by
default; use `-a`/`--noauto` to configure manually.
quadratic-time in the worst case (where the worst case is an extremely
repetitive reference). Default: off.
which contain a bitpacked version of the reference sequences and are
used for paired-end alignment.
which contain a bitpacked version of the reference sequences and are
used for paired-end alignment.
necessary to annotate ("mark") some or all of the [Burrows-Wheeler]
rows with their corresponding location on the genome. `-o`/`--offrate`
governs how many rows get marked: the indexer will mark every 2^`
rows. Marking more rows makes reference-position lookups faster, but
requires more memory to hold the annotations at runtime. The default
is 5 (every 32nd row is marked; for human genome, annotations occupy
about 340 megabytes).
[Burrows-Wheeler] range with respect to the first `
of the query. A larger `
query times. The ftab has size 4^(`
setting is 10 (ftab is 4MB).
By default, Ns are simply excluded from the index and `bowtie` will not
report alignments that overlap them.
Default: little-endian (recommended for Intel- and AMD-based
architectures).
(cumulative across sequences) and ignore the rest.
will print only error messages.
====================================
kind of index it is and what reference sequences were used to build it.
When run without any options, the tool will output a FASTA file
containing the sequences of the original references (with all
non-`A`/`C`/`G`/`T` characters converted to `N`s). It can also be used
to extract just the reference sequence names using the `-n`/`--names`
option or a more verbose summary using the `-s`/`--summary` option.
------------
of the index files but with the `.X.ebwt` or `.rev.X.ebwt` suffix
omitted. `bowtie-inspect` first looks in the current directory for the
index files, then looks in the `indexes` subdirectory under the
directory where the currently-running `bowtie` executable is located,
then looks in the directory specified in the `BOWTIE_INDEXES`
environment variable.
bases (default: 60).
as the names and lengths of the input sequences. The summary has this
format:
SA-Sample 1 in
FTab-Chars
Sequence-1
Sequence-2
...
Sequence-N
recreates the reference nucleotide sequences using the bit-encoded
reference nucleotides kept in the `.3.ebwt` and `.4.ebwt` index files.
When `-e/--ebwt-ref` is specified, `bowtie-inspect` recreates the
reference sequences from the Burrows-Wheeler-transformed reference
sequence in the `.1.ebwt` file instead. The reference recreation
process is much slower when `-e/--ebwt-ref` is specified. Also, when
`-e/--ebwt-ref` is specified and the index is in colorspace, the
reference is printed in colors (A=blue, C=green, G=orange, T=red).