myExperiment - Content

Taverna 2

Uploader

Donal Fellows

myExperiment Group Activity Report (1)

Prepares a report (three CSV files) on the activity of a group on myExperiment.

Created: 2014-08-26

Credits: Donal Fellows

Creator

Sven

View

Download

ARC to WARC migration with quality assurance scripts

Created: 2014-07-10 08:39:49

These are the tool service scripts used in Taverna workflow available on myExperiment (http://www.myexperiment.org/workflows/4333). The Taverna workflow is configured by adapting the values of the constant values (light-blue boxes) which define the paths to configuration files, deployment files, and scripts in the processing environment. However, as Taverna is just used as an orchestration tool to build a sequence of bash script invocations, it is also possible to just use the individual scri...

0 items in this pack

Comments: 0 | Viewed: 18 times | Downloaded: 10 times

This Pack has no tags!

Taverna 2

Uploader

Sven

ARC to WARC Migration with CDX Index and w... (1)

Download

Workflow for migrating ARC to WARC and comparing the CDX index files (Linux). The workflow has an input port “input_directory” which is a local path to the directory containing the ARC files, and an input port “output_directory” which is the directory where the workflow outputs are created. The files in the input directory are migrated using the “arc2warc_migration_cli” tool service component to perform the migration. The “cdx_creator_arc” and “cdx_creator_warc” tool service components creat...

Created: 2014-07-09

Credits: Sven

Taverna 2

Uploader

Sven

TIF to JP2 file format migration with qual... (1)

Download

This workflow reads a textfile containing absolute paths to TIF image files and converts them to JP2 image files using OpenJPEG (https://code.google.com/p/openjpeg). Based on the input text file, the workflow creates a Taverna list to be processed file by file. A temporary directory is created (createtmpdir) where the migrated image files and some temporary tool outputs are stored. Before starting the actual migration, it is checked if the TIF input images are valid file format instances u...

Created: 2014-05-07 | Last updated: 2014-05-07

Credits: Sven

Taverna 2

Uploader

Sven

ARC to WARC Migration and CDX Index Compar... (1)

Download

Workflow for migrating ARC to WARC and comparing the CDX index files (Linux). The workflow has an input port “input_directory” which is a local path to the directory containing the ARC files, and an input port “output_directory” which is the directory where the workflow outputs are created. The files in the input directory are migrated using the “arc2warc_migration_cli” tool service component to perform the migration. The “cdx_creator_arc” and “cdx_creator_warc” tool service components creat...

Created: 2014-04-23

Credits: Sven

Taverna 2

Uploader

Sven

ARC2WARC Hadoop Job (1)

Download

Just a wrapper workflow for a Hadoop job converting ARC to WARC files.

Created: 2014-03-06

Credits: Sven

Taverna 2

Uploader

Donal Fellows

Preservation Action Plan sampler (2)

Download

This is an example of the structure of a SCAPE Preservation Action Plan.

Created: 2014-03-05 | Last updated: 2014-03-05

Taverna 2

Uploader

Sven

ToMaR HDFS Input Directory Processing (2)

Download

This workflow allows processing an HDFS input directory using ToMaR. The "hdfs_working_dir" input port is the HDFS input directory which containes the data to be processed by ToMaR. The "toolspec" input port contains the toolspec XML describing operations that can be used (see "operation" input port). The "operation" input port defines the operation to be used in the current ToMaR job execution (see "toolspec" input port, an operation port used here must be defined in the tool specificatio...