Workflow Entry: DOI Record Generator

Created at: 29/04/09 @ 16:39:57

Version 1 (of 1)

Version created on: 29/04/09 @ 16:39:58 by: Andrea Wiggins | Revision comments Expand

Title: DOI Record Generator

Type: Taverna 1

Preview

(Click on the image to get the full size)

Download Scalable Diagram (SVG)

Description

This workflow generates DOI record files for deposit, using data set metadata for the FLOSSmole project. It reads in an input file generated from a SQL query from an eprints database, and transforms the parts of the source file as necessary to create a comprehensive DOI deposit record. It also generates DOIs for the data sets. These metadata are inserted into an XML record template (based on the std-doi.xsd schema) and the individual resources are aggregated into a single file.

Download

Download Workflow File/Package (SCUFL)

Run

Run this Workflow in the Taverna Workbench...

Option 1:

Launch in Taverna

Note: you need to have both the WHIP Launcher and the Taverna myExperiment/WHIP plugin installed on your machine for this to work. See here for information.

Option 2:

Copy and paste this link into File > 'Open workflow location...'
http://www.myexperiment.org/workflows/749/download?version=1
[ More Info Expand ]

Workflow Components

Inputs (1)

Name	Description
seed

Processors (18)

Name	Type	Description
file_location	stringconstant	Location of the source CSV with data for creating records.
split_rows	local	Takes a flat CSV input file and splits it into a list.
split_numbers_to_list	local	Takes a single string output and converts it to a list.
split_more	local	Takes the list input and creates a 2-deep list.
read_input	local	Shim to read in the file, location provided by a string constant.
split_formatted_filesize	local	Takes a single string input and splits it into a list of string inputs.
split_filesize_further	local	Splits the filesize string into two pieces, for size and units, so that the units can be replaced and appended to the size.
make_number_sequence	beanshell	Creates a sequential integer series for assignment to DOIs.
parse_url_for_source	beanshell	Extracts the name of the dataset file host from the download location URL.
aggregate_doi_records	beanshell	Aggregates the individual records into a single XML file.
build_URL_from_eprintid	beanshell	Constructs the metadata URL for FLOSSmole data sets, given the name of the eprintid.
split_fields	beanshell	Reads the 2-deep input list and splits out the values into separate variables.
generate_doi	beanshell	Creates a unique DOI string following the format <DOI.base>/<source>.<year>-<month>.<sequential number>.
generate_description	beanshell	Creates a general description of the data set contents to include additional metadata.
format_filesize	beanshell	Formats the filesize into Byte units by appending the metric unit prefix to the size value.
generate_xml_record	beanshell	Generates an XML DOI record according to the std-doi.xsd metadata standard schema.
construct_date	beanshell	Aggregates the individual date fields into a single date unit according to the standard for deposit.
format_months	beanshell	Ensures two-digit month values.

Beanshells (11)

Name	Description	Inputs	Outputs
make_number_sequence	Creates a sequential integer series for assignment to DOIs.	seed trigger	number_sequence
parse_url_for_source	Extracts the name of the dataset file host from the download location URL.	url	publicationPlace
aggregate_doi_records	Aggregates the individual records into a single XML file.	doi	import_file
build_URL_from_eprintid	Constructs the metadata URL for FLOSSmole data sets, given the name of the eprintid.	eprintid	url
split_fields	Reads the 2-deep input list and splits out the values into separate variables.	file	title eprintid year month day url media data_type file_type file_size source abstracts
generate_doi	Creates a unique DOI string following the format <DOI.base>/<source>.<year>-<month>.<sequential number>.	source year month seed	doi
generate_description	Creates a general description of the data set contents to include additional metadata.	media data_type file_type source metadata_url url abstracts	description
format_filesize	Formats the filesize into Byte units by appending the metric unit prefix to the size value.	filesize	formatted_filesize
generate_xml_record	Generates an XML DOI record according to the std-doi.xsd metadata standard schema.	filesize description publicationPlace publicationDate title doi	doi_records
construct_date	Aggregates the individual date fields into a single date unit according to the standard for deposit.	year month day	publicationDate
format_months	Ensures two-digit month values.	month	formatted_month

Outputs (1)

Name	Description
XMLoutput	Text output of XML input file for ePrints metadata records.

Links (35)

Source	Sink
build_URL_from_eprintid:url	generate_description:metadata_url
construct_date:publicationDate	generate_xml_record:publicationDate
file_location:value	read_input:fileurl
format_filesize:formatted_filesize	split_formatted_filesize:string
format_months:formatted_month	construct_date:month
format_months:formatted_month	generate_doi:month
generate_description:description	generate_xml_record:description
generate_xml_record:doi_records	aggregate_doi_records:doi
parse_url_for_source:publicationPlace	generate_xml_record:publicationPlace
read_input:filecontents	split_rows:string
seed	make_number_sequence:seed
generate_doi:doi	generate_xml_record:doi
make_number_sequence:number_sequence	split_numbers_to_list:string
split_fields:abstracts	generate_description:abstracts
split_fields:data_type	generate_description:data_type
split_fields:day	construct_date:day
split_fields:eprintid	build_URL_from_eprintid:eprintid
split_fields:eprintid	make_number_sequence:trigger
split_fields:file_size	split_filesize_further:string
split_fields:file_type	generate_description:file_type
split_fields:media	generate_description:media
split_fields:month	format_months:month
split_fields:source	generate_description:source
split_fields:source	generate_doi:source
aggregate_doi_records:import_file	XMLoutput
split_fields:title	generate_xml_record:title
split_fields:url	generate_description:url
split_fields:url	parse_url_for_source:url
split_fields:year	construct_date:year
split_fields:year	generate_doi:year
split_filesize_further:split	format_filesize:filesize
split_formatted_filesize:split	generate_xml_record:filesize
split_more:split	split_fields:file
split_numbers_to_list:split	generate_doi:seed
split_rows:split	split_more:string