UGENE integrates a set of tools for taxonomy classification of microorganisms using whole-genome shotgun sequencing data. The tools are Kraken, CLARK, DIAMOND, etc. See, for example, "Parallel NGS Reads Classification" sample workflow that allows one to classify input FASTQ files with these tools working in parallel and then join their output with another tool WEVOTE.

The tools are available on 64-bit macOS or Linux operating systems only. Also, as the tools are quite resource-consuming, it is recommended to have at least 16 Gb of RAM available.

To use these tools one should provide appropriate taxonomy data and reference data, specific for a tool. Some reference databases are provided for each of the tool. One can use these data or build a custom database (see, for example, workflow element "Build Kraken Database").

It is recommended to use the UGENE Online Installer package to install and automatically configure the data. However, if the Internet is not available on the target computer, or it is required to use another UGENE package for some other reason, follow the instructions below on how to download and configure the data.

Download data for metagenomics classification

Use links in the "Data for NGS metagenomics classification" section on the web page http://ugene.net/download-all.html to download the data.

Make sure to have enough disk space on the target computer.

See the list of the available downloads in the table below.

Data

Archive size

Unpacked data sizeDescriptionData source
NCBI taxonomy classification2.5 Gb31 GbThis includes a set of taxonomy data files from NCBI. These data should be present for any type the NGS classification analysis.Original data were downloaded from the NCBI FTP (ftp://ftp.ncbi.nlm.nih.gov/pub/taxonomy/).
NCBI RefSeq bacterial genomes130 Gb132 Gb

The data can be used to build a database for CLARK-l (light version of CLARK), CLARK, or Kraken.

As UGENE integrates modified version of CLARK/CLARK-l, it is possible to provide *.gz archives as input for building the database. In particular, "CLARK-l DB: RefSeq bacterial+viral genomes" (see below) was generated using the archived data.

Also, keep in mind that changing of some parameters of the "Classify Sequences with CLARK" element may cause re-building of the reference database. The reference data should be present in this case!

For building a Kraken database usage of *.gz archives is not supported, it is required to unpack each *.gz file, so even more disk space will be required.


Original data were downloaded from the NCBI FTP (ftp://ftp.ncbi.nlm.nih.gov/refseq/release/bacteria/bacteria*.genomic.fna.gz)
NCBI RefSeq viral genomes77 Mb77 Mb

Similarly to "NCBI RefSeq bacterial genomes", although the size of the data is rather small.

The reference data are included into "CLARK-l DB: RefSeq bacterial+viral genomes" and "CLARK-l DB: RefSeq viral genomes" databases.

Original data were downloaded from the NCBI FTP (ftp://ftp.ncbi.nlm.nih.gov/refseq/release/viral/viral*.genomic.fna.gz).
NCBI RefSeq GRCh38 human genome837 Mb838 Mb

Similarly to "NCBI RefSeq bacterial genomes".

The data are not included into any database, but provided in case one would like to use them when building a custom database.

Original data were downloaded from the NCBI FTP (ftp://ftp.ncbi.nih.gov/genomes/H_sapiens/CHR_*/hs_ref_GRC*chr*.fa.gz).
Kraken DB: MiniKraken 4Gb database2.5 Gb4.3 Gb

A sample reference database provided in UGENE for Kraken.

It is a pre-built 4 GB database constructed from complete bacterial, archaeal, and viral genomes in RefSeq (as of Oct. 18, 2017). This can be used by users without the computational resources needed to build a Kraken database. However this contains only 2.7% of kmers from the original database.

Original data were downloaded using a link on the Kraken web site (https://ccb.jhu.edu/software/kraken/).
CLARK-l DB: RefSeq bacterial+viral genomes7.4 Gb11 Gb

One of the reference databases provided in UGENE for CLARK-l.

The database was build using archived RefSeq bacterial and viral genomes.

See above.
CLARK-l DB: RefSeq viral genomes16 Mb72 Mb

One of the reference databases provided in UGENE for CLARK-l.

The database was build using archived RefSeq viral genomes.

See above.
DIAMOND DB: UniRef505.2 Gb13 Gb

One of the reference databases provided in UGENE for DIAMOND.

Note that unlike Kraken and CLARK, DIAMOND requires protein reference sequences as input.

Original data were downloaded from the Uniprot FTP (ftp://ftp.uniprot.org/pub/databases/uniprot/current_release/uniref/uniref50/uniref50.fasta.gz). Then a DIAMOND database was built.
DIAMOND DB: UniRef9013 Gb34 GbOne of the reference databases provided in UGENE for DIAMOND.Original data were downloaded from the Uniprot FTP (ftp://ftp.uniprot.org/pub/databases/uniprot/current_release/uniref/uniref90/uniref90.fasta.gz). Then a DIAMOND database was built.
MetaPhlAn2 embedded DB: mpa_v20_m2001 Gb1.2 GbThis database is provided with the MetaPhlAn2 tool. It was built on ~1M unique clade-specific marker genes identified from ~17,000 reference genomes (~13,500 bacterial and archaeal, ~3,500 viral, and ~110 eukaryotic).The database was downloaded here: https://bitbucket.org/biobakery/metaphlan2/downloads/.
Total:162 Gb227 Gb


Configure data

Data described above are stored as 7zip archives. After a file download, unpack it using an appropriate file archiver (for example, Keka on macOS).

The unpacked data are stored in a folders structure with the root folder called "data". For example, for "NCBI RefSeq viral genomes" the archive is called "ngs_classification.clark.viral_database.7z" and the unpacked data look as follows:

<center>
  <br>
  <img width="50%" src="/wiki/download/attachments/22061347/Configure NGS Classification Data_1.png"/>
  <br> 
</center>

It is required to move these data to the UGENE data folder, following the hierarchical data structure:

<center>
  <br>
  <img src="/wiki/download/attachments/22061347/Configure NGS Classification Data_2.png"/>
  <br> 
</center>

Thus, all required data will be placed to the "ngs_classification" sub-folder of the UGENE data folder.

Kraken, CLARK, DIAMOND and WEVOTE are integrated as external tools. So, also make sure the tools executables are set in the UGENE Application Settings.