Partek Flow Documentation

Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Navigate to the file using the browser as shown in Figure 2. The text file may be located in either the Partek Flow serverMy computer, or from a URL. However, if you wish to create the sample table and start importing the data at the same time (explained below), the text file must be on the Partek Flow serverURL (please see section below on file paths when including data import).

Check the box next to the text file that you want to use and click Next.

...

Text files that contain only sample IDs and attributes such as the one shown in Figure 3 can be imported to create a sample table with no associated files. For this type of import, the text file may be located in either the Partek Flow serverMy computer, or from a URL (Figure 2).

 

Numbered figure captions
SubtitleTextText with attributes
AnchorNameText with attributes

 

...

Click Import and the table will be created (Figure 5). Click Show data files to expand the table and associate files. For more details see the Adding samples section.

 

Numbered figure captions
SubtitleTextSample table created from a text file with attributes
AnchorNameSample table created from a text file with attributes

 

 

Include Data Import

 

If you have a text file that contains sample IDs and attributes as well as the filenames of your data, you can create the sample table and start the data import at the same time. This is particularly useful for projects where multiple files are associated with the same sample (e.g., a sample ran in multiple lanes in the sequencer).

For this type of import, the text file must may be located in either the Partek Flow server, (Figure 2My computer, or from a URL.  However, the data files should already be uploaded to the Partek Flow server (see section on file transfers).
In the text file, each filename to be associated with the sample must be separated by a tab. That means, if you are using a spreadsheet software to generate the text file, there is a maximum of one file per column. You also need to add headers such as file1, file2, etc., to define the columns. There is no limit on the number of columns on the text file. It is possible to have a different number of files associated with different samples.

 The filenames must show the proper extensions of data types compatible with Partek Flow (see Types of Data).The actual files can be in the same directory as the text file or in a different directory. If the files are in a different directory, you

Text file and data are both in server and in same directory

If text file containing the sample information and the data files to be imported are both in the Partek Flow server and are located in the same directorysimply include the filenames in the text file as shown in Figure 6. You do not have to specify the file path.

 

Numbered figure captions
SubtitleTextText with attributes and filenames
AnchorNameText with attributes and filenames

Image Added

 

Text file and data are in different directories

If text file containing the sample information and the data files to be imported are different directories, you must include the file paths

...

.

...

Text file and data are in the same directory

...

 

For text files located in the Partek Flow serverbut in different directories, you can use relative or absolute file paths.

For text files located in "My  the text file and the data are in different locations (e.g., text file is in a local My Computer and data is in the Partek Flow Server) you must use an absolute file path.

Relative paths

 

You can use a path relative to the location of the text file you are using to create the sample table. For example in Figure 7, the text file is located in a directory called "download" while the files are in a subdirectory called MyData, then the filenames must include the path /MyData/. An example is shown below:

/MyData/NA1031_S25_L007_R1_001.fastq.gz

 

Numbered figure captions
SubtitleTextThe text file is located in a directory called "download" while the files are located in a directory one level below called "MyData"
AnchorNameThe text file is located in a directory called "download" while the files are located in a directory one level below called "MyData"

Image Added

 

Absolute path

You can use the full path to the file based on your Partek Flow server.  You must include the paths starting from the Partek Flow home directory (Figure 8, red box). For typical installations, the path begins with /home/flow/FlowData/ and so the filenames to include in the text file may look like this:

/home/flow/FlowData/download/MyData/NA1031_S25_L007_R1_001.fastq.gz

 

Numbered figure captions
SubtitleText

Text with attributes and filenamesAnchorNameText with attributes and filenamesImage Removed

The Current directory (red box) shows the file path to be included in a text file containing absolute paths
AnchorNameThe Current directory (red box) shows the file path to be included in a text file containing absolute paths

Image Added

 

 

Once you have selected the text file with filenames and/or file paths, click Next.

 

Similar to the previous section, the text file will be summarized as in Figure 78. If the file types are valid, Partek Flow will recognize the filenames and locate the files within the directory.  The Files column represent files to be imported.

 

Numbered figure captions
SubtitleTextSelecting the attributes, Sample ID and filenames
AnchorNameSelecting the attributes, Sample ID and filenames

 

 

Click Import and the table will be created. After a few seconds, the server icon  will be animated (Figure 89). This means that the process of importing data files have started. Click the Queue dropdown and select View queued tasks... to see the queue of import tasks (Figure 910).

 

Numbered figure captions
SubtitleTextSample table created from a text file and data is queued for import
AnchorNameSample table created from a text file and data is queued for import

Numbered figure captions
SubtitleTextTask Queue showing import tasks for each sample
AnchorNameTask Queue showing import tasks for each sample


At this stage, you can also go to the Analyses Tab of the project and see that the data node has been created but the color is light blue, which indicates the import is not complete (Figure 1011, left). Once all the files have been imported from the queue, the data node will appear darker (Figure 1011, right).

 

Numbered figure captions
SubtitleTextAnalyses Tab showing data node during import (left) and once the import is completed (right)
AnchorNameAnalyses Tab showing data node during import (left) and once the import is completed (right)

 

To view the files associated with the data, go to the Data Tab and click Show data files to expand the table. Figure 11 12 shows that four files were successfully imported for each sample. You can add more or delete samples as described in the Adding samples section.

 

Numbered figure captions
SubtitleTextExpanded sample table created from a text file with attributes and associated data files
AnchorNameExpanded sample table created from a text file with attributes and associated data files

 

Text file and data are in different directories

If your samples are in different subdirectories, you must include the path in for your file name. You can use either a relative path or an absolute path.

Relative paths

You can use a path relative to the location of the text file you are using to create the sample table. For example in Figure 12, the text file is located in a directory called "download" while the files are in a subdirectory called MyData, then the filenames must include the path /MyData/. An example is shown below:

/MyData/NA1031_S25_L007_R1_001.fastq.gz

 

Numbered figure captions
SubtitleTextThe text file is located in a directory called "download" while the files are located in a directory one level below called "MyData"
AnchorNameThe text file is located in a directory called "download" while the files are located in a directory one level below called "MyData"

Image Removed

 

Absolute path

You can use the full path to the file based on your Partek Flow server.  You must include the paths starting from the Partek Flow home directory (Figure 13, red box). For typical installations, the path begins with /home/flow/FlowData/ and so the filenames to include in the text file may look like this:

/home/flow/FlowData/download/MyData/NA1031_S25_L007_R1_001.fastq.gz

 

Numbered figure captions
SubtitleTextThe Current directory (red box) shows the file path to be included in a text file containing absolute paths
AnchorNameThe Current directory (red box) shows the file path to be included in a text file containing absolute paths

Image Removed

Additional assistance

 

 

Rate Macro
allowUsersfalse