Partek Flow Documentation

Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The User added tasks feature is a part of the Partek Flow Enterprise offerings and requires a separate license. Having this license allows the addition of new user added tasks and allows existing user added tasks to be run individually or within pipelines. To check if your installation is licensed, go to Settings > Licensing and make sure that the User added tasks is licensed (Figure 1).

 


Numbered figure captions
SubtitleTextThe User added tasks require a separate enterprise license
AnchorNameThe User added tasks require a separate enterprise license

...

To create a new user added task, go to Settings > Task management. Select the Add task button and choose Create new task in the pop-up dialog (Figure 2).

 


Numbered figure captions
SubtitleTextAdding a User added Task
AnchorNameAdding a User added Task

...

The task creation wizard will guide you through each step. Please consult the user documentation of the analysis tool you wish to add for details to enter into the task creation wizard.

Task details

 


Numbered figure captions
SubtitleTextDefining the task details
AnchorNameDefining the task details
 

...

  • Task name - a unique name for the task
  • Description (optional) - a more thorough description of the task. This text will appear when the cursor hovers over the task in the Task Menu
  • Version - a unique version number for the given task name. The combination of Task name + Version must be unique (i.e., no other task already installed can have the same combination)
  • Section - choose a section in the context-sensitive Task Menu in which this task will appear or define a new section by editing the text field (Figure 4)

    Numbered figure captions
    SubtitleTextChoose which section in the Task Menu you want the added task to appear in. To keep all custom tasks in one section, choose 'Custom tasks' at the bottom of the drop-down list (left). To create a new section, highlight the text and manually type a new section name (right)
    AnchorNameChoose which section in the Task Menu you want the added task to appear in. To keep all custom tasks in one section, choose 'Custom tasks' at the bottom of the drop-down list (left). To create a new section, highlight the text and manually type a new section name (right)

    Image Modified Image Modified


  • Executable - provide a full path to the executable that this task will run (Figure 5) by clicking Browse. The executable is the main binary or script to call when the user added task is runwhich has arguments parsed in the command-lines. In the example in Figure 3, the full path is /home/flow/.partekflow/user_tasks. The dialog (Figure 5 inset) lists all the available executables stored in the directory. Select the file and click Continue to proceed. Note that the flow server user must have execute permission on the binary. 


    SECURITY WARNING - Since binaries in this folder will be accessible through the Partek Flow web user interface, this directory should be highly restricted from modification by non-administrator users.

     

    Numbered figure captions
    SubtitleTextSelecting the executable (the inset shows the available binary saved in the folder)
    AnchorNameSelecting the executable (the inset shows the available binary saved in the folder)


...

Click Next to proceed to the Input step

 


Input

In the Input step, specify what type of data the task can run on and how to pass that data on the command line (Figure 7). 


 

Numbered figure captions
SubtitleTextDefining the Input
AnchorNameDefining the Input

  • Input data type - This is the type of data the task can be performed on. In the Analyses tab, this is the type of data node that will be selected for to the task to appear in the context-sensitive Task menu. Partek Flow requires User added tasks to be performed on either: Unaligned reads, Aligned reads, Quantification, and Variants. Additional inputs can be specified in the Options step. The type of Input data selected from the drop-down menu will determine the additional fields that need to be defined. In Figure 7 the Subread Aligner task accepts Unaligned reads.
  • Input from - choose Parameter if the input file(s) is specified using an option (e.g. -r) on the command line or Last option if the executable assumes the input file(s) is placed at the end of the command
  • Accepts paired-end - choose between Yes, No or Exclusively with respect to the task's behavior with paired-end reads
  • Single-end parameter - enter the parameter to add before single-end reads
  • 1st pair parameter - enter the parameter to add before the first file (_1) in a paired-end reads set
  • 2nd pair parameter - enter the parameter to add before the first file (_2) in a paired-end reads set 

You can optionally include Sample information as an argument to pass to the command (Figure 8). Select Include sample info and enter the Sample info parameter. The parameter is used to specify the sample information file on the command line. 


 

Numbered figure captions
SubtitleTextIncluding the Sample Information
AnchorNameIncluding the Sample Information

 


A tab-delimited text file will be passed to the command line using the specified parameter. Each row in the file will be composed of the File name, Sample name, and its associated attributes in that project (Figure 9). When running the command on All samples, the text file will have all sample files as rows. When running the command as Each sample then there will be one info file per command and it will only contain the rows for the files in that sample.

...

The expected outputs of the task must be defined and configured. To add a new output, select the Add output button (Figure 10), then configure the dialog (Figure 11).

 


Numbered figure captions
SubtitleTextTable of Output of a User Added Task
AnchorNameTable of Output of a User Added Task

 

 



Numbered figure captions
SubtitleTextConfiguring a task output
AnchorNameConfiguring a task output

 


  • Type - choose the type of data produced by the task from the drop-down list. The set of output types is restricted to those currently supported by downstream Partek Flow tasks: Unaligned readsAligned readsAssembled reads, Quantification, HTML, Image, or Variants. If you want to output a data type that is not part of this set, select Custom and this will produce an output that can be downloaded
  • Name - enter a name for the output data node (this will be the data node that will display in the Analyses tab)
  • Exposed - if checked, this output will be exposed as a node on the Analyses tab, otherwise this task will not produce a data node and the output will be accessible through the task result page
  • Required - if checked the task will fail if the executable failed to produce this output.  If left unchecked then this output is optional and task will succeed even if this output was never be produced by the executable.
  • Ouput files as - (for Custom types) choose between a Single file output, All files with prefix, and a list of files in a Directory

  • Output prefix - to restrict only output files with the given prefix
  • Output to - placement of output on the command line, which can be: Last Option, Parameter, Standard Out

  • Output parameter - parameter to place on the command line before this output

...

Numbered figure captions
SubtitleTextTable of Options for the User Added Task
AnchorNameTable of Options for the User Added Task

 

 


Numbered figure captions
SubtitleTextConfiguring additional task options
AnchorNameConfiguring additional task options

...

Numbered figure captions
SubtitleTextTask management table showing a User added task
AnchorNameTask management table showing a User added task

 


Like native Partek Flow tasks this task can have its system wide version set, and can be globally enabled or disabled. Unlike native Partek Flow tasks, there are additional actions that can be taken on user added tasks:

...

The Name of the User added task will appear as a task node in the Analyses tab (Figure 19). 


Numbered figure captions
SubtitleTextA successful run of a User added task
AnchorNameA successful run of a User added task

Image Modified


Integration Scripts


User added tasks has some format restrictions for passing arguments to the command line.

...

User added tasks also require a single binary per task. So if you wish to execute multiple steps and have that represented as a single task in Partek Flow, one must first wrap those steps in a script that can be imported into Partek Flow.


Additional assistance



 

Rate Macro
allowUsersfalse

...