Partek Flow Documentation

Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

This process of generating a sample table based on a text file can only be done once per project.  Additional Additional samples or attributes can still be added using the Import data or Manage attributes buttons.

...

The text file must be created outside of Partek® Flow® (you can use software such as Partek® Genomics Suite®, Microsoft® Excel® or any text editor). A valid text file is a tab-delimited text file that contains one sample per row and columns containing sample information. At least one column must have unique entries and will be suggested as Sample IDs. Additional columns may contain numeric or categorical attributes and (optional) filenames. Examples of text files are shown in Figures 3 , X, Y, Zand 6.

To select the text file, create a new project and in the blank Data Tab (no samples have been imported yet), click the Assign sample attributes from a file button (Figure 1). 

 

Numbered figure captions
SubtitleTextA new project with no samples in the Data Tab
AnchorNameA new project with no samples in the Data Tab

 

...

If you have a text file that contains sample IDs and attributes as well as the filenames of your data, you can create the sample table and start the data import at the same time. This is particularly useful for projects where multiple files are associated with the same sample (e.g., a sample ran in multiple lanes in the sequencer).  For this type of import, the text file must be located in the Partek Flow server (Figure 2).

In the text file, each filename to be associated with the sample must be separated by a tab.  That That means, if you are using a spreadsheet software to generate the text file, there is a maximum of one file per column.  You You also need to add headers such as file1, file2, etc., to define the columns. There is no limit on the number of columns on the text file. 

...

 

Numbered figure captions
SubtitleTextText with attributes and filenames
AnchorNameText with attributes and filenames


The text file will be summarized as in Figure 7. Filenames that are recognized as valid file types and also located in the same folder as the text file are presented in the Files column.

 

 

Numbered figure captions
SubtitleTextSelecting the attributes, Sample ID and filenames
AnchorNameSelecting the attributes, Sample ID and filenames

 

 

Click Import and the table will be created (Figure 8).  Once Once the table has been created, wait for a few seconds and you will notice that the server icon is animated. This means the the process of importing the files have started.   Click Click the Queue dropdown and you can select View queued tasks... and that each file is being being imported into the project (Figure 9).  

 

Numbered figure captions
SubtitleTextSample table created from a text file and data is queued for import
AnchorNameSample table created from a text file and data is queued for import

Numbered figure captions
SubtitleTextTask Queue showing files import tasks for each file
AnchorNameTask Queue showing files import tasks for each file


At this stage, you can also go to the Analyses Tab of the project and see that the data node has been created but the color is light blue, which indicates the import is not complete.

Once all the files have been imported from the queue, Analyses Tab will show the data node to be dark blue,

 

 

Numbered figure captions
SubtitleTextAnalyses Tab showing data node during import (left) and once the import is completed (right)
AnchorNameAnalyses Tab showing data node during import (left) and once the import is completed (right)

 

To view the files associated with the data, go to the Data Tab and click Show data files to expand the table. Figure 11 shows that 4 files were successfully imported for each sample. You can add more or delete samples as described in the Adding samples section.

 

Numbered figure captions
SubtitleTextExpanded sample table created from a text file with attributes and associated data files
AnchorNameExpanded sample table created from a text file with attributes and associated data files

 

...

If your samples are in different subdirectories, you must include the path in for your file name. You can use either a relative path or an absolute path.

Relative paths

This means the the path you will include is relative to the location of the text file. For example in Figure 12, the text file is located in a directory called "download" while the files are in a subdirectory called MyData, then the filenames must include the path /MyData/. An example is shown below:

/MyData/NA1031_S25_L007_R1_001.fastq.gz

 

Numbered figure captions
SubtitleTextThe text file is located in a directory called "download" while the files are located in a directory one level below called "MyData"
AnchorNameThe text file is located in a directory called "download" while the files are located in a directory one level below called "MyData"

 

Absolute path

This means the the path you will include is the full file path to the file based on the file structure of Partek Flow.  Where Where the text file is located you can simply add the directories based on the Partek Flow home directory (see region in red box in Figure 13).  For For typical installations, the path begins with /home/flow/FlowData/ and so the filenames to include in the text file may look like this:

/home/flow/FlowData/download/MyData/NA1031_S25_L007_R1_001.fastq.gz

 

 

 

Numbered figure captions
SubtitleTextThe Current directory (red box) shows the file path to be included in a text file containing absolute paths
AnchorNameThe Current directory (red box) shows the file path to be included in a text file containing absolute paths

 

 

...