...
To review and edit library file management settings, you must be logged into Partek Flow as a user with administrator privileges. Click on the avatar in the top right corner and choose Settings. Then click System preferences on the left. You can review the current library file directory location and privilege settings that determine whether non-administrative users can add or remove library files (Figure 2).
| Numbered figure captions |
|---|
| SubtitleText | System preferences page showing library file directory location and privilege settings. Settings can be changed by clicking on Edit system preferences at the bottom |
|---|
| AnchorName | sys-preferences |
|---|
|
|
To change where the library files are stored, click
Edit system preferences at the bottom and click
Browse to point to another directory (Figure 3).
| Numbered figure captions |
|---|
| SubtitleText | Changing where the library files are stored |
|---|
| AnchorName | library-file-dir |
|---|
|
|
You can control whether non administrative users can manage library files. If you only want administrative users to manage library files, click
Edit system preferences and select the checkbox shown in Figure 4. Non Administrative users will still be able to view the library files. Unselecting the checkbox will allow any user to manage library files, but only administrative users can remove entire assemblies. The assemblies and library files created by non administrative users will be available for all Partek Flow users.
| Numbered figure captions |
|---|
| SubtitleText | Change whether administrative or non administrative users can manage library files. |
|---|
| AnchorName | admis-manage-library-files |
|---|
|
|
...
The library file management page has two tabs - Genomic library files and Microarray library files. This section of the user guide will focus on the Genomic library files tab, which is relevant for next-generation sequencing analysis (Figure 5).
| Numbered figure captions |
|---|
| SubtitleText | Genomic library files page |
|---|
| AnchorName | genomic-library-files-page |
|---|
|
|
The gray arrows (/) expand/collapse each section. Associated library files are shown in a table in each section. The view file () icon in the Actions column of each table displays additional library file details. The red cross () dissociates a library file. The hourglass () icon indicates a library file is being created...
Choosing an Assembly from the drop-down list at the top will display the associated library files in the pane below. Assemblies are named by the species and the build version (e.g. Homo sapiens (human) - hg19). Different build versions for the same species are regarded as separate assemblies (Figure 6). Administrative users can delete a selected assembly by clicking the red cross ( ).
| Numbered figure captions |
|---|
| SubtitleText | Human assembly versions hg17, hg18 and hg19 will appear as separate assemblies in the drop-down list. |
|---|
| AnchorName | human-assembly-versions |
|---|
|
|
...
Reference aligner indexes. Next-generation sequencing aligners require the reference sequence to be indexed prior to alignment, as this greatly increases alignment speed. An index consists of a set of files (Figure 7) and are generally aligner specific. For example, if you wish to align using BWA, you need a BWA index.
| Numbered figure captions |
|---|
| SubtitleText | BWA reference aligner index files for human hg18 assembly |
|---|
| AnchorName | bwa-library-file-details |
|---|
|
|
Some of the supported aligners share indexes. If you want to align using Tophat, the Bowtie aligner indexes can be used. If you want to align using Tophat2, the Bowtie2 aligner indexes can be used.
...
Annotation models are used for quantification in gene expression analyses, annotating detected variants (e.g. to predict amino acid changes), visualizations in Chromosome view, generating coverage reports and for aligner index creation (see below). Typical file formats include GTF, GFF, GFF3 and BED.
| Numbered figure captions |
|---|
| SubtitleText | Annotation models are displayed in separate tables. |
|---|
| AnchorName | annotation-models |
|---|
|
|
The
gray arrows (
/
) next to the annotation model name expand/collapse each table. The three annotation models displayed are different versions from the same source (RefSeq), distinguishable by their date. Aligner indexes (e.g. for alignment to the transcriptome) are added to the table of the corresponding annotation model.
...
The library index is a file that contains download sources for all Partek distributed library files. An automatic update of this file will occur every 24 hours (Figure 9), so this normally doesn't require any attention. If you do wish to manually update the library index, click Update Library Index at the bottom of the library file management page.
| Numbered figure captions |
|---|
| SubtitleText | The date and time the library index was last updated is displayed at the bottom of the library file management page. |
|---|
| AnchorName | ubdate-lib-index |
|---|
|
|
...
On the library file management page, an assembly can be added by choosing Add assembly… from the Assembly drop-down list (Figure 10). If the list is long, you may need to scroll to the bottom.
| Numbered figure captions |
|---|
| SubtitleText | Adding an assembly on the library file management page |
|---|
| AnchorName | add-assembly |
|---|
|
|
In the
Add assembly dialog, choose the
Species from the drop-down list (Figure 11), followed by the
Assembly version (Figure 12) and click
Add. The dialog will automatically load commonly used assembly versions for the selected species (Figure 12). If the assembly version you want does not appear in the list, choose
Other and type the custom assembly version name (Figure 13). Note that If an assembly version for a given species already exists on your system, it will not appear in the drop down list.
| Numbered figure captions |
|---|
| SubtitleText | Add assembly dialog. The species can be chosen from the drop-down list |
|---|
| AnchorName | add-assembly-species |
|---|
|
|
| Numbered figure captions |
|---|
| SubtitleText | For the chosen species, commonly used assembly versions can be chosen from the drop-down list |
|---|
| AnchorName | add-assembly-assembly |
|---|
|
|
| Numbered figure captions |
|---|
| SubtitleText | A new assembly version can be added by choosing Other and typing the custom assembly version name manually |
|---|
| AnchorName | add-assembly-other |
|---|
|
|
If the species you want to add does not appear in the list, scroll to the bottom of the species list, choose
Other and manually type the species name and assembly version (Figure 14).
| Numbered figure captions |
|---|
| SubtitleText | A new species can be added by typing the name and assembly name manually |
|---|
| AnchorName | add-assembly-other-species |
|---|
|
|
...
Library files can be added to an assembly by clicking the green plus ( ) icon next to the header of each section (Figure 15) on the library file management page. This will open a dialog specific to the chosen section. If all possible library files are already associated in each section, the green plus icon will appear gray (Figure 15).
| Numbered figure captions |
|---|
| SubtitleText | The green plus icon is used to add library files to a section on the library file management page (left). The icon turns gray if all possible library files have been added to a section (right). |
|---|
| AnchorName | add-file-section |
|---|
|
|
Alternatively, library files can be added by clicking on the green
Add library file button on the library file management page (Figure 16). Choose a
library type from the drop-down list in the
Add library file dialog (Figure 17) and the dialog will present options specific for each type. If certain library files have already been associated with an assembly, they will not appear as options in the dialogs. For example, if a reference sequence has already been associated with an assembly, it will not appear as an option in the drop-down list shown in Figure 17.
| Numbered figure captions |
|---|
| SubtitleText | Add library file button on library file management page |
|---|
| AnchorName | add-lib-file-button |
|---|
|
|
| Numbered figure captions |
|---|
| SubtitleText | Add library file dialog |
|---|
| AnchorName | Add-lib-file-dialog |
|---|
|
Image Modified |
All library file tasks are logged in the System queue, which can be accessed by clicking on the avatar in the top right corner, choosing Settings and clicking System queue on the left. When a library file is being created, the hourglass icon ( ) will appear in the Actions column (Figure 5, above). Clicking this icon will display information on the task progress (Figure 18).
| Numbered figure captions |
|---|
| SubtitleText | Clicking the hourglass icon displays the task progress |
|---|
| AnchorName | lib-file-progress |
|---|
|
Image Modified |
Adding a Reference Sequence
Click the green plus ( ) icon next to the Reference Files section header (Figure 15, above) and choose Reference sequence from the Library type drop-down list in the Add reference sequence dialog (Figure 19). Alternatively, click the Add library file button and choose Reference sequence from the Library type drop-down list (Figure 17, above). If a cytoband file is already associated with an assembly, Reference sequence will be the only option available in the Add reference sequence dialog and will not appear in a drop-down list (Figure 19).
| Numbered figure captions |
|---|
| SubtitleText | Add reference sequence dialog. If the reference sequence and cytoband files have not been added yet, both options will appear in the Library type drop-down list (left). If one is missing, it will appear as the only option (right). For many model organisms, automatic downloads are available from the Partek repository. |
|---|
| AnchorName | add-ref-seq |
|---|
|
|
If you are using an assembly supported by Partek (e.g. human), there are two radio button options:
Download reference sequence and
Import reference sequence (Figure 19, above). Select
Download reference sequence and click
Create to get the reference sequence from the Partek repository. Alternatively, select
Import reference sequence and click
Create to add the reference sequence from another source.
If you are using a custom assembly (e.g. for a non-model organism), only the
Import reference sequence radio button will be available (Figure 20).
| Numbered figure captions |
|---|
| SubtitleText | For custom assemblies, automatic downloads are not available so the reference sequence has to be imported from another source. |
|---|
| AnchorName | custom-ref |
|---|
|
|
The
Import reference sequence option allows you to add a reference sequence from the
Partek Flow Server,
My Computer or a
URL download link (Figure 21).
| Numbered figure captions |
|---|
| SubtitleText | A reference sequence can be added from multiple sources |
|---|
| AnchorName | lib-file-select-file |
|---|
|
|
To add a reference sequence from the Partek Flow server, select
Partek Flow Server, click
Browse and navigate to the directory storing the reference sequence file(s) (Figure 22). Only files with the correct file extensions (.fa, .2bit or any compressed format) will be displayed in the file browser. Select the checkbox next to the file name(s) you wish to import and click
Continue (Figure 22). Click
Finish to add the selected reference sequence file(s) (Figure 21).
| Numbered figure captions |
|---|
| SubtitleText | Add a reference sequence file(s) from the Partek Flow Server |
|---|
| AnchorName | add-ref-seq-server |
|---|
|
|
To upload a reference sequence from your local computer select
My computer, click
Choose file and navigate to the location of the file(s) on your local machine (Figure 23). It is not advisable to upload large files through the web browser, as this will likely result in an error (e.g. an upload timeout). Administrative users are able to set a limit on the upload file size via
System preferences (Figure 2, above). The default file size limit is 500 MB. Please note that only one file can be uploaded at a time. Click
Finish to add the selected reference sequence file(s) (Figure 23).
| Numbered figure captions |
|---|
| SubtitleText | Upload a reference sequence file from your local computer through the browser |
|---|
| AnchorName | upload-ref-seq |
|---|
|
|
To download a reference sequence (e.g. from a public repository such as ENSEMBL), select
URL and input the URL address (Figure 24). Make sure to include the full URL address, starting with the transfer protocol (e.g. http:// or ftp://) and ending with the file name. It is advisable to find the download link address, copy it to the clipboard and paste it into the
Input URL box. Click
Finish to add the selected reference sequence file(s) (Figure 24).
...
Click the green plus ( ) icon next to the Reference Files section header (Figure 15, above) and choose Cytoband from the Library type drop-down list in the Add reference sequence dialog (Figure 25). Alternatively, click the Add library file button and choose Cytoband from the Library type drop-down list (Figure 17, above). If a reference sequence is already associated with an assembly, Cytoband will be the only option available in the Add genome dialog and will not appear in a drop-down list (Figure 25).
| Numbered figure captions |
|---|
| SubtitleText | Add reference sequence dialog. If the reference sequence and cytoband files have not been added yet, both options will appear in the Library type drop-down list (left). If one is missing, it will appear as the only option (right). For many model organisms, automatic downloads are available from the Partek repository. |
|---|
| AnchorName | add-cytoband |
|---|
|
|
If you are using an assembly supported by Partek (e.g. human), there are two radio button options:
Download cytoband and
Create cytoband from 2bit (Figure 25). Select
Download cytoband and click
Create to get the cytoband file from the Partek repository. Alternatively, select
Create cytoband from 2bit and click
Create to build the cytoband file. If the reference sequence is missing, it will either be downloaded automatically or you will be asked to import it from another source (see
Adding a reference sequence).
If you are using a custom assembly (e.g. for a non-model organism), only the Create cytoband from 2bit option is available (Figure 26).
| Numbered figure captions |
|---|
| SubtitleText | For custom assemblies, automatic downloads are not available so the cytoband has to be created |
|---|
| AnchorName | custom-cytoband |
|---|
|
|
...
Click the green plus ( ) icon next to the Reference aligner indexes section header. Alternatively, click the Add library file button, choose Aligner index from the Library type drop-down list (Figure 17, above) and whole genome from the Index to drop-down list. If an aligner index is already associated with an assembly, it will not appear in the Aligner drop-down list. If all but one of the possible aligner indexes have been added, the remaining aligner index will be the only option and will not appear in a drop-down list (Figure 27).
| Numbered figure captions |
|---|
| SubtitleText | Add aligner index dialog. If more than one aligner index has not been added to an assembly, the missing aligner indexes will appear in the drop-down list (left). If only one aligner index remains to be added, it will be the only option (right). For many model organisms, automatic downloads are available from the Partek repository. |
|---|
| AnchorName | add-aligner-index-dialog |
|---|
|
|
Choose the aligner index you wish to add from the drop-down list in the
Add aligner index dialog (Figure 27). The following indexes can be added:
...
For custom assemblies (e.g. for non-model organisms), only the Build index and Import index options are available (Figure 28).
| Numbered figure captions |
|---|
| SubtitleText | For custom assemblies, automatic downloads are not available so the aligner indexes has to be built or imported |
|---|
| AnchorName | build-index |
|---|
|
|
...
Click the green plus ( ) icon next to the Gene sets section header. Alternatively, click the Add library file button and choose Gene set from the Library type drop-down list (Figure 17, above).
If you are using an assembly supported by Partek (e.g. human), a gene set from geneontology.org will appear in the Add gene set drop-down list (Figure 29). Select the Download gene set radio button and click Create.
| Numbered figure captions |
|---|
| SubtitleText | For many model organisms, automatic downloads of gene sets are available from the Partek repository (source: http://geneontology.org/) |
|---|
| AnchorName | add-gene-set |
|---|
|
|
If you prefer to add a custom gene set, or if you are working with a custom assembly, choose
Add gene ontology source from the
Add gene set drop-down list (Figure 30). Name the gene set by typing into the
Custom Name box and click
Create. A gene set file can be added from the
Partek Flow Server,
My Computer or a
URL download link. The behavior of each option is similar to when importing a reference sequence (see
Adding a reference sequence, above). When browsing for files on the Partek Flow server, only the files with relevant file extensions will be visible (.gmt and various compressed formats).
| Numbered figure captions |
|---|
| SubtitleText | Adding a custom gene set |
|---|
| AnchorName | adding-custom-gene-set |
|---|
|
|
...
Multiple versions of the above databases are available. For human - hg38, only dbSNP is currently available. This list is periodically updated.
| Numbered figure captions |
|---|
| SubtitleText | For human - hg19, automatic downloads of various variant annotation databases are available from the Partek repository. |
|---|
| AnchorName | add-variant-annotation-db |
|---|
|
|
Choose a database from the drop-down list, select the
Download variant database radio button and click
Create.
If you prefer to add a custom variant annotation database, perhaps from another source or 'gold-standard' validated variants, choose Add variant database from the Variant annotation drop-down list (Figure 32). Name the variant annotation database by typing into the Custom Name box and click Create. A variant annotation database can be added from the Partek Flow Server, My Computer or a URL download link. The behavior of each option is similar to when importing a reference sequence (see Adding a reference sequence, above). When browsing for files on the Partek Flow server, only the files with relevant file extensions will be visible (.vcf and various compressed formats).
| Numbered figure captions |
|---|
| SubtitleText | Add a custom variant annotation database |
|---|
| AnchorName | add-custom-variant-annotation |
|---|
|
|
...
If you are using human (hg19 and hg38), mouse (mm10) or rat (rn5 and rn6) assemblies, various versions of SNPEff variant databases are available for automatic download (Figure 33).
| Numbered figure captions |
|---|
| SubtitleText | Various versions of SNPEff variant databases are available for automatic download. The drop-down list shows databases available for human - hg19 Choose a SNPEff database from the drop-down list, select the Download SNPEff variant database radio button and click Create. |
|---|
| AnchorName | add-snpeff-db |
|---|
|
|
...
If you are using an assembly supported by Partek (e.g. human), annotation models from a variety of commonly used sources (e.g. RefSeq, ENSEMBL, GENCODE) will appear in the Annotation model drop-down list in the dialog. Choose an annotation model, select the Download annotation file radio button and click Create (Figure 34).
| Numbered figure captions |
|---|
| SubtitleText | For many model organisms, automatic downloads of gene/feature annotation models from various sources are available from the Partek repository. |
|---|
| AnchorName | add-annot-model |
|---|
|
|
If you prefer to add a custom annotation file or if you are working with a custom assembly, choose
Add annotation model from the
Annotation model drop-down list (Figure 35). You may need to scroll to the bottom of the drop-down list to see this option. Name the annotation model by typing into the
Custom Name box and click
Create.
| Numbered figure captions |
|---|
| SubtitleText | Add a custom annotation model |
|---|
| AnchorName | add-custom-annot-model |
|---|
|
|
A custom annotation model can be added from the
Partek Flow Server,
My Computer or a
URL download link. The behavior of each option is similar to when importing a reference sequence (see
Adding a reference sequence, above). When browsing for files on the Partek Flow server, only the files with relevant file extensions will be visible (.gtf, .gff, .gff3, .bed, .pannot and various compressed formats). You must specify the type of annotation file by choosing an option from the
Annotation data type drop-down list (Figure 36).
| Numbered figure captions |
|---|
| SubtitleText | When importing an annotation model, the data type must be specified |
|---|
| AnchorName | import-annot-specify-type |
|---|
|
|
...
If you are using an assembly supported by Partek (e.g. human), annotation models from a variety of commonly used sources will appear in the Index to drop-down list in addition to the ones that have already been associated with the assembly. If you choose an annotation model that has not already been associated, it will automatically be downloaded prior to building the index.
| Numbered figure captions |
|---|
| SubtitleText | Building an aligner index for an annotation model |
|---|
| AnchorName | build-aligner-index |
|---|
|
|
...
- Under the Analyses tab of a project, select a Feature list data node
- Choose Biological interpretation from the menu on the right, followed by Enrichment analysis
If there are no gene set files associated with the relevant assembly, click Create gene set (Figure 40)
| Numbered figure captions |
|---|
| SubtitleText | If no gene sets are associated with the assembly, click the button to add one. |
|---|
| AnchorName | create-gene-set |
|---|
|
|
- If you are working with an assembly/species supported by Partek (e.g. human), choose a gene set from the Create gene set drop-down list (Figure 41), select the Download gene set radio button and select Create. Alternatively, choose Add gene ontology source from the Create gene set drop-down list, manually type the custom gene set name and click Create to import your own gene set from the Partek Flow server, My computer or URL (Figure 42). If you are working with a custom species/assembly (e.g. for a non-model organism), only the Add gene ontology source option is available.
| Numbered figure captions |
|---|
| SubtitleText | Download a gene set using the Create gene set dialog from within a project |
|---|
| AnchorName | select-gene-set |
|---|
|
|
| Numbered figure captions |
|---|
| SubtitleText | Import a gene set using the Create gene set dialog from within a project |
|---|
| AnchorName | custom-gene-set-task |
|---|
|
|
...
Microarray library files can be managed by clicking the Microarray libraries tab on the Library file management page (Figure 43). The chip name and download source of stored Microarray library files are shown in the table.
| Numbered figure captions |
|---|
| SubtitleText | Microarray libraries files tab |
|---|
| AnchorName | microarray-lib-file |
|---|
|
|
Microarray probe tab files are used for processing microarray data in Partek Flow. When microarray intensity data files (e.g. Affymetrix .CEL files) are imported into a project, the chip type is automatically detected and the appropriate probe tab annotation file is downloaded. Thus, you would normally not need to manually add any probe tab annotation files.
To manually download a probe tab file, click the green Add probe sequence button at the top of the page (Figure 43, above). Choose the chip name from the drop-down list in the dialog, select the Download probe sequence radio button and click Create (Figure 44). If a chip has already been added, it will not appear in the Chip name drop-down list. We currently support automatic downloads of a broad variety of Affymetrix and Illumina microarray chips.
| Numbered figure captions |
|---|
| SubtitleText | Manually download microarray probe tab annotation files |
|---|
| AnchorName | add-probe-seq |
|---|
|
|
To add a custom probe tab file (e.g. for a custom chip), click the green
Add probe sequence button at the top of the page (Figure 43, above). Scroll to the bottom of the
Chip name drop-down list and choose
Other / Custom. Name the chip by typing into the
Custom Name box and click the
Create button (Figure 45).
| Numbered figure captions |
|---|
| SubtitleText | Adding a custom probe tab file e.g. for a custom microarray chip |
|---|
| AnchorName | add-custom-probe-seq |
|---|
|
|
A custom probe tab file can be added from the
Partek Flow Server,
My Computer or a
URL download link. The behavior of each option is similar to when importing a reference sequence (see
Adding a reference sequence, above). When browsing for files on the Partek Flow server, only the files with relevant file extensions will be visible (.probe_tab and various compressed formats). Please see the Importing Custom CEL files user guide for more information.
...