The Partek® Flow® Uploader is a Torrent Browser plugin that lets users easily upload run results into their Partek Flow server for further analysis.
For quick video on how to run the plugin, you can go directly here.
This guide is for Partek® Flow® Uploader v.1.02 and covers the following:
For a quick video on how to run the plugin
Download the Partek® Flow® Uploader from this link. This is a compressed zipped file
Installation of the Plugin
Installation only needs to be performed once per Torrent Browser. All users of the same instance of Torrent Browser will be able to use the plugin. For future versions of the plugin, the steps below can also be used for updating.
Figure 1: Torrent Browser
Figure 2: Accessing the Plugins
Figure 3: Installing a new plugin in the Torrent Browser
Figure 4: Uploading and installing the zip file of the plugin
Figure 5: Table showing the Partek Flow Uploader successfully installed
Figure 6: Accessing the Global configuration of the Partek Flow Uploader
Global Partek Flow configuration settings can be entered into the plugin. When set, it will serve as the default for all users of the Torrent Browser. If multiple Partek Flow users are expected to run the plugin, it is recommended to leave the username and password fields blank so that individual users can enter them as needed.
In the configuration dialog (Figure 7), enter the Partek Flow URL, your username and your password. Clicking on Check configuration would verify your credentials and indicate if a valid username and password has been entered. Click Save when done.
Figure 7: Global Plugin configuration settings
In the Torrent Browser, you can configure a Run Plan to include the Partek Flow Uploader.
In the example in Figure 8, the Partek Flow Uploader will be included in an existing Run Plan. From the Planned Runs page, click the gear icon in the last column, and choose Edit.
Figure 8: Selecting an existing Run Plan to Edit
Figure 9: Editing the Plugins section of the Run Plan
The Project Name field will be used in Partek Flow to create a new project where the run results will be exported. However, if a project with that name already exists, the samples will be added to that existing project. This enables you to combine multiple runs into one project. Project Names are limited to 30 characters. If not specified, the plugin will use the Run Name as the Project Name.
Click the Check configuration button to see if you typed a valid username and password. When ready, click Save Changes to proceed.
Figure 10: Configuring the Partek Flow Uploader as part of a Run Plan
Figure 11: Partek Flow Uploader showing successful transfer
Figure 12: Partek Flow Homepage with the new Project created by Partek Flow Uploader
You can manually invoke the plugin from a completed run report. This allows you to export the data from the Torrent Server if you did not include the plugin in the original run plan. This also gives you the flexibility to export the same run results onto different project(s).
Figure 13: Running the Plugin from a completed run
Figure 14: Selecting the Partek Flow Uploader Plugin
Figure 15: Configuring the Partek Flow Uploader from a Report
Enter the Partek Flow URL, your username and your password (Figure 15). These are the same credentials you use to access Partek Flow directly on a web browser. Although some fields may already be pre-populated depending on the global plugin configuration, you can edit the entries as needed. All fields are required to successfully run the plugin.
The Project Name field will be used in Partek Flow to create a new project where the run results will be exported. However, if a project with that name already exists, the samples will be added to that existing project. This enables you to combine multiple runs into one project. Project Names are limited to 30 characters. The default project name is the Run Name.
When ready, click Export to Partek Flow to proceed. If you wish to cancel, click on the X on the lower right of the dialog box.
Note that configuring the Plugin from a report (Figure 15) is very similar to configuring it as part of a Run Plan (Figure 10) with two notable differences:
Figure 16: The plugin is Queued as indicated and a blue Stop button is available
Click the button to update.
The Partek Flow Uploader plugin sends the data to the Partek Flow server. Once transferred, Partek Flow then proceeds to validate the data within a Project.
There may be some occasions when the plugin is already done transferring the data but Partek Flow is still validating it. This can easily be checked by expanding the sample table. To do so, open the project in Partek Flow, select the Data tab, and click the Show data files link on the lower left of the table (Figure 17).
Figure 17: Expanding the Sample Table to display the Data files
If the data is still being validated, the table will have empty cells in the Files column (Figure 18). Refresh the page and make sure the table is complete before proceeding.
Figure 18: Data still being validated and the project is not yet ready
Once data validation is done, the table should be complete (Figure 19).
Figure 19: All files are validated and the project is ready
If the validation fails to succeed, some files will not be imported (cells will remain blank) and there will be a notification in the Log Tab. Refer to the Run Report in the Torrent Browser to check if there was any issue in the run.
The Sample Table in Partek Flow (Figure 19) has corresponding information in the Run Report of the Torrent Browser (Figure 20).
The Sample name in Partek Flow corresponds to the Sample column in the Output files section of the Run Report. The unaligned BAM (UBAM) file for each sample has been transferred to Partek Flow and appears in the bam (Files) column. The Run Name is added as a sample attribute.
For reads that have no barcodes, the Torrent Browser does not assign a sample name (shown as None on the first row of Figure 20). These reads are also transferred to Partek Flow. For clarity, the plugin assigned them to a sample named No barcode (first row in Figure 19).
Figure 20: Torrent Browser run report showing corresponding items in the Partek Flow Sample table in red
To add multiple Runs to the same Partek Flow Project, configure the plugin and use the same Project Name (Figure 10 or Figure 15). The samples will be combined in the same project. Figure 21 shows a Partek Flow Sample table from two Ion Torrent Runs (note the Run Name column).
If two different runs have the same sample names, each would appear as a separate row with names appended (e.g., Sample 1.1).
Figure 21: Partek Flow project containing data from multiple runs. Duplicate samples are appended by a dot followed by a number
Samples you do not wish to include in your analysis (particularly those with no barcodes) can be easily deleted by clicking the gear icon next to the sample name and selecting Delete sample (Figure 22).
Figure 22: Deleting samples in Partek Flow
The data transferred by the Partek Flow Uploader is stored in a directory created for the Project within the user's default project output directory. For example, in Figure 19, the data for this project is stored in:
/home/flow/FlowData/jsmith/Project_CHP Hotspot Project
The plugin transfers the Unaligned BAM data from the Torrent Browser. The UBAM file format retains all the information of the Ion Torrent Sequencer. In the Partek Flow Project, the Analyses tab would show a circular data node named Unaligned bam. Click on the data node and the context-sensitive task menu will appear on the right (Figure 23).
Unaligned BAM files are only compatible with the TMAP aligner, which can be selected in the Aligners section of the Task Menu. If you wish to use other aligners, you can convert the unaligned BAM files to FASTQ using the Convert to FASTQ task under Pre-alignment tools.
Some information specific to Ion Torrent Data (such as Flow Order) are not retained in the FASTQ format. However, those are only relevant to Ion Torrent developed tools (such as the Torrent Variant Caller) and are not relevant to any other analysis tools.
Figure 23: Analyses tab of Partek Flow showing the task menu available for the selected Unaligned BAM file data node
Once converted, the reads can then be aligned using a variety of aligners compatible with fastq input (Figure 24) . You can also perform other tasks such as Pre-alignment QAQC or run an existing pipeline.
Another option is to include the Convert to FASTQ task in your pipeline and you can invoke the pipeline directly from an Unaligned bam data node.
Figure 24: Unaligned reads in the FASTQ format are compatible with more tasks
Deleting data in Partek Flow can be done by deleting the project. During project deletion, you will be given an opportunity to delete data. These include the data transferred by the Partek Flow plugin (Input Files) and the data generated by any Task within Partek Flow (Output Files). Deleting data in Partek Flow does not delete any data in the Torrent Browser.
There are a couple of ways to delete a project. From the Partek Flow home page, click the delete icon under the Actions column (Figure 10). You can also have the project open and click the gear icon on the top right of the page and select Delete project (Figure 25).
Figure 25: Deleting an open project in Partek Flow
A page displaying all the files associated with the project appears. Click the triangle to expand the list. Select the files to be deleted from the server by clicking the corresponding checkboxes next to each file (Figure 26). By default, all Output files generated by the project are selected. The Input files list all the data uploaded by the plugin.
Figure 26: Expanded selection of files to be deleted in with one file being shared by another project
You do not have to delete files to delete a Project. Should you retain the files, they will remain in the Partek Flow server and can be deleted outside Partek Flow.
|