Workflows

Common SCAPE QA command line tool RESTful ... (1)

• Download

The QA REST package enables creation of RESTful web service that wraps any QA command line tools. The main element of this workflow is a RESTful service designed in the SCAPE QA command line tools RESTful package https://github.com/openplanets/scape/tree/master/pc-qa-toolwrapper-rest. The Github project https://github.com/openplanets/scape/tree/master/xa-rester from Andy Jackson is a basis implementation for pc-qa-toolwrapper-rest package. The workflow comprises path to the RESTful servi...

Created: 2011-07-01 | Last updated: 2012-04-04

Credits: Roman

Extract histogram features from image file... (1)

• Download

The main element of this workflow is a RESTful service designed in the SCAPE QA command line tools RESTful package https://github.com/openplanets/scape/tree/master/pc-qa-toolwrapper-rest. The Github project https://github.com/openplanets/scape/tree/master/xa-rester from Andy Jackson is a basis implementation for pc-qa-toolwrapper-rest package. The QA REST package enables creation of RESTful web service that wraps QA command line tool like ‘extractfeatures’ or ‘create’...

Created: 2011-07-01 | Last updated: 2012-04-04

Credits: Roman

JP2 to TIFF file format migration with qua... (1)

• Download

This workflow reads a textfile containing absolute paths to JP2 image files and converts them to TIFF image files using Kakadu's j2k_to_image command line application (http://www.kakadusoftware.com). Based on the input text file, the workflow creates a Taverna list to be processed file by file. A temporary directory is created (createtmpdir) where the migrated image files and some temporary tool outputs are stored. Before converting the files, the JP2 input files are validated using the SC...

Created: 2013-02-07

Credits: Sven

Hadoop hOCR parser (1)

• Download

Big data processing: chaining Hadoop jobs using Taverna. This workflow demonstrates a simple way of linking different hadoop job components using the standard output of the hadoop jobs. It is not for thought for productive use, but for demonstration using small data sets. The code for the hadoop jobs is available on Github: tb-lsdr-hocrparser and tb-lsdr-seqfilecreator.

Created: 2012-08-07 | Last updated: 2012-08-07

Credits: Sven

Converts any ImageMagick supported image f... (1)

• Download

SCAPE Migration Component

Created: 2014-02-12

Credits: Markus Plangg

Hadoop Large Document Collection Data Prep... (1)

• Download

Workflow for preparing large document collections for data analysis. Different types of hadoop jobs (Hadoop-Streaming-API, Hadoop Map/Reduce, and Hive) are used for specific purposes. The *PathCreator components create text files with absolute file paths using the unix command 'find'. The workflow then uses 1) a Hadoop Streaming API component (HadoopStreamingExiftoolRead) based on a bash script for reading image metadata using Exiftool, 2) the Map/Reduce component (HadoopHocrAvBlockWidthMapR...

Created: 2012-08-17 | Last updated: 2012-08-18

Credits: Sven

Tool for detecting changes in web pages an... (1)

• Download

SCAPE QA Object Component

Created: 2014-04-07

Credits: Zeynep Pehlivan

Image files comparison using histograms an... (2)

• Download

This workflow extracts histogram and profile features from image file applying image processing command line tool. Necessary configuration files are stored on Github (https://github.com/openplanets/scape/tree/master/pc-qa-toolwrapper). As a template for creation of image workflows was used xa-toolwrapper project from Sven Schlarb (https://github.com/openplanets/scape/tree/master/xa-toolwrapper). This workflow provides WSDL web service that wraps command line tool with tho options ‘extra...

Created: 2011-11-22 | Last updated: 2011-11-23

Credits: Roman

Compare histogram features of image files (1)

• Download

As a template for creation of image workflows was used xa-toolwrapper project from Sven Schlarb (https://github.com/openplanets/scape/tree/master/xa-toolwrapper). This project enables creation of WSDL web service that wraps command line tool like ‘extractFeatures’ or ‘create’. The workflow for ‘compare’ tool has three input parameters. These are two URLs to the XML histogram files that comprise information about image features. These files are acquired us...

Created: 2011-06-16 | Last updated: 2012-04-04

Credits: Roman

Photohawk SSIM tiff/png/jpeg (4)

• Download

SCAPE QA Object Component. Compares tiff/png/jpeg images using Photohawk SSIM.

Created: 2014-04-01 | Last updated: 2014-10-30

Photohawk AE tiff/png/jpeg (3)

• Download

SCAPE QA Object Component. Compares tiff/png/jpeg images using Photohawk AE.

Created: 2014-04-09 | Last updated: 2014-10-30

Photohawk equal tiff/png/jpeg (2)

• Download

SCAPE QA Object Component. Compares tiff/png/jpeg images using Photohawk equal.

Created: 2014-04-09 | Last updated: 2014-09-07

Photohawk MAE tiff/png/jpeg (3)

• Download

SCAPE QA Object Component. Compares tiff/png/jpeg images using Photohawk MAE.

Created: 2014-04-09 | Last updated: 2014-10-30

Photohawk MSE tiff/png/jpeg (3)

• Download

SCAPE QA Object Component. Compares tiff/png/jpeg images using Photohawk MSE.

Created: 2014-04-09 | Last updated: 2014-10-30

Photohawk PAE tiff/png/jpeg (5)

• Download

SCAPE QA Object Component. Compares tiff/png/jpeg images using Photohawk PAE.

Created: 2014-04-09 | Last updated: 2014-10-30

Photohawk SSIM tiff/png/jpeg-jp2 (3)

• Download

SCAPE QA Object Component. Compares tiff/png/jpeg to jp2 images using Photohawk SSIM.

Created: 2014-09-07 | Last updated: 2014-09-07

Credits: Markus Plangg

Photohawk MSE tiff/png/jpeg-jp2 (1)

• Download

SCAPE QA Object Component. Compares tiff/png/jpeg to jp2 images using Photohawk MSE.

Created: 2014-09-07

Credits: Markus Plangg

Photohawk AE tiff/png/jpeg-jp2 (1)

• Download

SCAPE QA Object Component. Compares tiff/png/jpeg to jp2 images using Photohawk AE.

Created: 2014-09-07

Credits: Markus Plangg

Photohawk MAE tiff/png/jpeg-jp2 (1)

• Download

SCAPE QA Object Component. Compares tiff/png/jpeg to jp2 images using Photohawk MAE.

Created: 2014-09-07

Credits: Markus Plangg

Photohawk PAE tiff/png/jpeg-jp2 (1)

• Download

SCAPE QA Object Component. Compares tiff/png/jpeg to jp2 images using Photohawk PAE.

Created: 2014-09-07

Credits: Markus Plangg

wc - Comparative File Size (2)

• Download

SCAPE QA Object Component. Measures the file size and comparative file size of two images.

Created: 2014-11-06 | Last updated: 2014-11-06

Credits: Markus Plangg

Mp3ToWav Mig+QA (2)

• Download

Migrates Mp3 files from input List to Wav files and performs QA. The QA steps include File Format Validation, Significant Property Comparison and migrationQA file content comparison (all CLI). This workflow matches solution SO4 on the SCAPE opf wiki, see http://wiki.opf-labs.org/display/SP/SO4+Audio+mp3+to+wav+Migration+and+QA+Workflow

Created: 2012-05-21 | Last updated: 2013-04-24

Credits: Bolette Jurik

Mp3 To Wav Migrate QA CLI List Test (4)

• Download

Migrates Mp3 files from input List to Wav files and performs QA. The QA steps include File Format Validation, Significant Property Comparison and migrationQA file content comparison (all CLI). As this is a Test workflow, the (very large) Wav files are deleted, and only the QA results and log files are saved for analysis. This workflow matches solution SO4 on the SCAPE opf wiki, see http://wiki.opf-labs.org/display/SP/SO4+Audio+mp3+to+wav+Migration+and+QA+Workflow

Created: 2012-11-05 | Last updated: 2012-11-13

Credits: Bolette Jurik

Matchbox Evaluation (1)

• Download

Matchbox evaluation against ground truth. The evaluation process first creates the matchbox output and ground truth lists. It then counts each page tuple from the matchbox output that is in the ground truth as correctly identified tuple (true positive). Those that are not in the ground truth are counted as incorrectly identified tuples (false positives), and finally, those that are in the ground truth but not in the matchbox output are counted as missed tuples (false negatives). The precision...

Created: 2012-10-02 | Last updated: 2012-10-02

Credits: Sven

Find Duplicates using Matchbox command lin... (1)

• Download

The workflow takes a list of digital documents as input, extracts SIFT features using image processing algorithms, creates dictionary of visual words, generates BoW (Bag of Words) histogramms and finds duplicates. The count of parallel threads can be passed as a parameter. Finally search results are stored in a text file that contains a list of possible duplicates with associated similarity score. This score values are spread between 0 (low similarity) and 1 (high similarity). Image compariso...

Created: 2012-07-31 | Last updated: 2012-07-31

Credits: Roman

Extract histogram features from image file (1)

• Download

As a template for creation of image workflows was used xa-toolwrapper project from Sven Schlarb (https://github.com/openplanets/scape/tree/master/xa-toolwrapper). This project enables creation of WSDL web service that wraps command line tool like ‘extractFeatures’ or ‘create’. The workflow for ‘extractFeatures’ tool has two input parameters. The URL to the input image file and the number of histogram bins as integer. This workflow extracts histogram feature...

Created: 2011-06-16 | Last updated: 2012-04-04

Credits: Roman

Jpylyzer Review Demonstration (1)

• Download

 Review demonstration workflow that compares the jpylyzer tool with the struct checker and jhove.  Runs on British Library JISC 1 content, looking for invalid images.

Created: 2012-03-15 | Last updated: 2012-03-15

Credits: Carl

ToMaR HDFS Input Directory Processing (2)

• Download

This workflow allows processing an HDFS input directory using ToMaR. The "hdfs_working_dir" input port is the HDFS input directory which containes the data to be processed by ToMaR. The "toolspec" input port contains the toolspec XML describing operations that can be used (see "operation" input port). The "operation" input port defines the operation to be used in the current ToMaR job execution (see "toolspec" input port, an operation port used here must be defined in the tool specificatio...

Created: 2014-03-04 | Last updated: 2014-03-11

Credits: Sven

Image QA (RAW/NonRAW, Ssim, Equals) (1)

• Download

Reads images either by reading the file directly or using dcraw depending on the image mimetype. Then runs QA algorithms to compare the images.

Created: 2012-02-27 | Last updated: 2012-02-27

Credits: Markus Plangg

Planning Overview (Scp, Migration, Charact... (1)

• Download

Copies an image from a remote path using scp. Then starts a migration action on the image and extracts properties from the original and migrated image. The properties are compared and on the image data itself, QA algorithms are started.

Created: 2012-02-28

Credits: Markus Plangg

Simple executable plan example (1)

• Download

A simple executable plan containing a migration action component and a QA component. The migration action uses imagemagick convert. The QA component consists of two characterisation components (fits) and another QA components (imagemagick compare).

Created: 2012-06-29

Credits: Markus Plangg

A heuristic measure for detecting undesire... (2)

• Download

The workflow takes TIFF image instances as input, applies a list of JP2 compression parameter values, executes OCR using an open source OCR engine, evaluates the results, and creates a diagram visualising the results. Dependencies on external tools for the tool service components: Tesseract ImageMagick Kakadu Gnuplot Dependencies on external Java libraries of beanshells: Apache commons lang

Created: 2012-02-06 | Last updated: 2012-03-09

Credits: Sven

Migration Imagemagick convert no compression (2)

• Download

Converts an image using imagemagick convert -compress None

Created: 2013-02-25 | Last updated: 2013-02-26

Credits: Kraxner Markus Plangg

Attributions:

AIT Matchbox Scenario Compare Image Pair b... (1)

• Download

In this scenario matchbox will compare given image pair based on extracted profile information. User will get a histogram intersection distance value in result. Small value means high similarity, high value means different images. Matchbox in this scenario is installed on remote Linux VM. Digital collection is stored on Windows machine.

Created: 2012-11-24

Credits: Roman

Migration ffmpeg audio to wav pcm_s32le (1)

• Download

Converts audio to wav using ffmpeg with codec pcm_s32le

Created: 2013-01-24

Credits: Markus Plangg

AIT Matchbox Scenario Find Duplicates usin... (1)

• Download

In this scenario matchbox will find duplicates in passed digital collection. All matchbox workflow steps are defined separately using input parameter sequence: clean, extract, train, bowhist and compare. User will get a list of duplicates in result. Matchbox in this scenario is installed on remote Linux VM. Digital collection is stored on Windows machine.

Created: 2012-11-24

Credits: Roman SCAPE

AIT Matchbox Scenario Professional (3)

• Download

In this scenario matchbox will find duplicates in passed digital collection. Each matchbox workflow step can be executed separately. User will get a list of duplicates in result. Matchbox in this scenario is installed on remote Linux VM. Digital collection is stored on Windows machine. This workflow starts duplicate finding process using the FindDuplicates python script of the matchbox tool. Matchbox tool support python in version 2.7. Execution starts from the directory where python scripts ...

Created: 2012-11-24 | Last updated: 2012-11-24

Credits: Roman SCAPE