weaver.processes.convert
¶
Module Contents¶
-
weaver.processes.convert.
WPS_FIELD_FORMAT
= ['formats', 'supported_formats', 'supported_values', 'default'][source]¶
-
weaver.processes.convert.
complex2json
(data: Union[ComplexData, Any]) → Union[JSON, Any][source]¶ Obtains the JSON representation of a
ComplexData
or simply return the unmatched type.
-
weaver.processes.convert.
metadata2json
(meta: Union[ANY_Metadata_Type, Any], force: bool = False) → Union[JSON, Any][source]¶ Obtains the JSON representation of a
OWS_Metadata
orpywps.app.Common.Metadata
. Otherwise, simply return the unmatched type. If requested, can enforce parsing a dictionary for the corresponding keys.
-
weaver.processes.convert.
ows2json_field
(ows_field: Union[ComplexData, OWS_Metadata, AnyValueType]) → Union[JSON, AnyValueType][source]¶ Obtains the JSON or raw value from an
owslib.wps
I/O field.
-
weaver.processes.convert.
ows2json_io
(ows_io: OWS_IO_Type) → JSON_IO_Type[source]¶ Converts I/O from
owslib.wps
to JSON.
-
weaver.processes.convert.
ows2json_output
(output: owslib.wps.Output, process_description: owslib.wps.Process, container: Optional[AnySettingsContainer] = None) → weaver.typedefs.JSON[source]¶ Utility method to jsonify an output element from a WPS1 process description.
In the case that a reference JSON output is specified and that it refers to a file that contains an array list of URL references to simulate a multiple-output, this specific output gets expanded to contain both the original URL
reference
field and the loaded URL list underdata
field for easier access from the response body.
-
weaver.processes.convert.
_get_multi_json_references
(output: owslib.wps.Output, container: Optional[AnySettingsContainer]) → Optional[List[JSON]][source]¶ Since WPS standard does not allow to return multiple values for a single output, a lot of process actually return a JSON array containing references to these outputs.
Because the multi-output references are contained within this JSON file, it is not very convenient to retrieve the list of URLs as one always needs to open and read the file to get them. This function goal is to detect this particular format and expand the references to make them quickly available in the job output response.
- Returns
Array of HTTP(S) references if the specified output is effectively a JSON containing that,
None
otherwise.
-
weaver.processes.convert.
any2cwl_io
(wps_io: Union[JSON_IO_Type, WPS_IO_Type, OWS_IO_Type], io_select: str) → Tuple[CWL_IO_Type, Dict[str, str]][source]¶ Converts a WPS-like I/O to CWL corresponding I/O. Because of CWL I/O of type File with format field, the applicable namespace is also returned.
- Returns
converted I/O and namespace dictionary with corresponding format references as required
-
weaver.processes.convert.
xml_wps2cwl
(wps_process_response: requests.models.Response) → Tuple[CWL, JSON][source]¶ Converts a WPS-1 ProcessDescription XML tree structure to an equivalent WPS-3 Process JSON and builds the associated CWL package in conformance to weaver.processes.wps_package.CWL_REQUIREMENT_APP_WPS1.
- Parameters
wps_process_response – valid response (XML, 200) from a WPS-1 ProcessDescription.
-
weaver.processes.convert.
is_cwl_array_type
(io_info: CWL_IO_Type) → Tuple[bool, str, MODE, Union[AnyValue, List[Any]]][source]¶ Verifies if the specified I/O corresponds to one of various CWL array type definitions.
- returns
tuple(is_array, io_type, io_mode, io_allow)
where: is_array
: specifies if the I/O is of array type.io_type
: array element type ifis_array
is True, type ofio_info
otherwise.io_mode
: validation mode to be applied if sub-element requires it, defaults toMODE.NONE
.io_allow
: validation values to be applied if sub-element requires it, defaults toAnyValue
.
- Raises
PackageTypeError – if the array element doesn’t have the required values and valid format.
- returns
-
weaver.processes.convert.
is_cwl_enum_type
(io_info: CWL_IO_Type) → Tuple[bool, str, int, Union[List[str], None]][source]¶ Verifies if the specified I/O corresponds to a CWL enum definition.
- returns
tuple(is_enum, io_type, io_allow)
where: is_enum
: specifies if the I/O is of enum type.io_type
: enum base type ifis_enum=True
, type ofio_info
otherwise.io_mode
: validation mode to be applied if input requires it, defaults toMODE.NONE
.io_allow
: validation values of the enum.
- Raises
PackageTypeError – if the enum doesn’t have the required parameters and valid format.
- returns
-
weaver.processes.convert.
cwl2wps_io
(io_info: CWL_IO_Type, io_select: str) → WPS_IO_Type[source]¶ Converts input/output parameters from CWL types to WPS types.
- Parameters
io_info – parsed IO of a CWL file
io_select –
WPS_INPUT
orWPS_OUTPUT
to specify desired WPS type conversion.
- Returns
corresponding IO in WPS format
-
weaver.processes.convert.
any2cwl_literal_datatype
(io_type: str) → Union[str, Type[null]][source]¶ Solves common literal data-type names to supported ones for CWL.
-
weaver.processes.convert.
any2wps_literal_datatype
(io_type: weaver.typedefs.AnyValueType, is_value: bool) → Union[str, Type[null]][source]¶ Solves common literal data-type names to supported ones for WPS. Verification is accomplished by name when
is_value=False
, otherwise with pythontype
whenis_value=True
.
-
weaver.processes.convert.
json2wps_datatype
(io_info: JSON_IO_Type) → str[source]¶ Guesses the literal data-type from I/O JSON information in order to allow creation of the corresponding I/O WPS. Defaults to
string
if no suitable guess can be accomplished.
-
weaver.processes.convert.
json2wps_field
(field_info: JSON_IO_Type, field_category: str) → Any[source]¶ Converts an I/O field from a JSON literal data, list, or dictionary to corresponding WPS types.
- Parameters
field_info – literal data or information container describing the type to be generated.
field_category – one of
WPS_FIELD_MAPPING
keys to indicate how to parsefield_info
.
-
weaver.processes.convert.
json2wps_io
(io_info: JSON_IO_Type, io_select: Union[WPS_INPUT, WPS_OUTPUT]) → WPS_IO_Type[source]¶ Converts an I/O from a JSON dict to PyWPS types.
- Parameters
io_info – I/O in JSON dict format.
io_select –
WPS_INPUT
orWPS_OUTPUT
to specify desired WPS type conversion.
- Returns
corresponding I/O in WPS format.
-
weaver.processes.convert.
wps2json_io
(io_wps: WPS_IO_Type) → JSON_IO_Type[source]¶ Converts a PyWPS I/O into a dictionary based version with keys corresponding to standard names (WPS 2.0).
-
weaver.processes.convert.
wps2json_job_payload
(wps_request: pywps.app.WPSRequest, wps_process: pywps.Process) → weaver.typedefs.JSON[source]¶ Converts the input and output values of a
pywps
WPSExecute
request to corresponding WPS-REST job.The inputs and outputs must be parsed from XML POST payload or KVP GET query parameters, and converted to data container defined by
pywps
based on the process definition.
-
weaver.processes.convert.
get_field
(io_object: Union[ANY_IO_Type, ANY_Format_Type], field: str, search_variations: bool = False, pop_found: bool = False, default: Any = null) → Any[source]¶ Gets a field by name from various I/O object types.
Default value is
null
used for most situations to differentiate from literalNone
which is often used as default for parameters. TheNullType
allows to explicitly tell that there was ‘no field’ and not ‘no value’ in existing field. If you provided another value, it will be returned if not found within the input object.- Returns
matched value (including search variations if enabled), or
default
.
-
weaver.processes.convert.
set_field
(io_object: Union[ANY_IO_Type, ANY_Format_Type], field: str, value: Any, force: bool = False) → None[source]¶ Sets a field by name into various I/O object types. Field value is set only if not
null
to avoid inserting data considered invalid. Ifforce=True
, verification ofnull
value is ignored.
-
weaver.processes.convert.
_are_different_and_set
(item1: Any, item2: Any) → bool[source]¶ Compares two value representations and returns
True
only if both are notnull
, are of sametype
and of different representative value. By “representative”, we consider here the visual representation of byte/unicode strings to support XML/JSON and Python 2/3 implementations. Other non string-like types are verified with literal (usual) equality method.
-
weaver.processes.convert.
is_equal_formats
(format1: Union[Format, JSON], format2: Union[Format, JSON]) → bool[source]¶ Verifies for matching formats.
-
weaver.processes.convert.
merge_io_formats
(wps_formats: List[ANY_Format_Type], cwl_formats: List[ANY_Format_Type]) → List[ANY_Format_Type][source]¶ Merges I/O format definitions by matching
mime-type
field. In case of conflict, preserve the WPS version which can be more detailed (for example, by specifyingencoding
).Verifies if
DEFAULT_FORMAT_MISSING
was written to a single CWL format caused by a lack of any value provided as input. In this case, only WPS formats are kept.In the event that
DEFAULT_FORMAT_MISSING
was written to the CWL formats and that no WPS format was specified, theDEFAULT_FORMAT
is returned.- Raises
PackageTypeError – if inputs are invalid format lists
-
weaver.processes.convert.
merge_package_io
(wps_io_list: List[ANY_IO_Type], cwl_io_list: List[WPS_IO_Type], io_select: Union[WPS_INPUT, WPS_OUTPUT]) → List[WPS_IO_Type][source]¶ Update I/O definitions to use for process creation and returned by GetCapabilities, DescribeProcess. If WPS I/O definitions where provided during deployment, update CWL-to-WPS converted I/O with the WPS I/O complementary details. Otherwise, provide minimum field requirements that can be retrieved from CWL definitions.
Removes any deployment WPS I/O definitions that don’t match any CWL I/O by ID. Adds missing deployment WPS I/O definitions using expected CWL I/O IDs.
- Parameters
wps_io_list – list of WPS I/O (as json) passed during process deployment.
cwl_io_list – list of CWL I/O converted to WPS-like I/O for counter-validation.
io_select –
WPS_INPUT
orWPS_OUTPUT
to specify desired WPS type conversion.
- Returns
list of validated/updated WPS I/O for the process matching CWL I/O requirements.
-
weaver.processes.convert.
transform_json
(json_data: ANY_IO_Type, rename: Optional[Dict[AnyKey, Any]] = None, remove: Optional[List[AnyKey]] = None, add: Optional[Dict[AnyKey, Any]] = None, replace_values: Optional[Dict[AnyKey, Any]] = None, replace_func: Optional[Dict[AnyKey, Callable[[Any], Any]]] = None) → ANY_IO_Type[source]¶ Transforms the input json_data with different methods. The transformations are applied in the same order as the arguments.