ISO/IEC 23090-8:2020
Information technology — Coded representation of immersive media — Part 8: Network based media processing
The network-based media processing (NBMP) framework defines the interfaces including both data formats and application programming interfaces (APIs) among the entities connected through digital networks for media processing. Users can access and configure their operations remotely for efficient, intelligent processing. This document describes and manages workflows to be applied to the media data. This process includes uploading of media data to the network, instantiation of the media processing tasks, and configuration of the tasks. The framework enables dynamic creation of media processing pipelines, as well as access to processed media data and metadata in real-time or in a deferred way. The media and metadata formats used between the media source, workflow manager and media processing entities in a media processing pipeline are also specified.
Foreword
Introduction
1 Scope
2 Normative references
3 Terms, definitions and abbreviated terms
3.1 Terms and definitions
3.2 Abbreviated terms
4 Conventions
5 Overview
5.1 General
5.2 Architecture
5.3 NBMP workflow
5.3.1 General
5.3.2 Workflow processing model
5.3.3 Task allocation and distribution
5.3.4 Workflow graph
5.4 Relationship between logical definitions, data objects and REST resources
5.5 Description of the defined entities in this document
5.5.1 NBMP APIs
5.5.2 Content format
5.5.3 Definitions
5.5.4 Functional behaviour
6 NBMP descriptions
6.1 NBMP function description (FD)
6.1.1 General
6.1.2 Description
6.1.3 Function group
6.1.3.1 General
6.1.3.2 Example
6.1.3.3 Requirements
6.2 NBMP task description (TD)
6.2.1 General
6.2.2 Description
6.2.2 Task lifecycle
6.3 NBMP workflow description (WD)
6.3.1 General
6.3.2 Description
6.3.3 Workflow lifecycle
7 NBMP interfaces
7.1 General
7.2 Workflow APIs
7.2.1 General
7.2.2 Workflow resources
7.2.3 Workflow API operations
7.3 Task APIs
7.3.1 General
7.3.2 Task resource
7.3.3 Task API operations
7.4 Function discovery APIs
7.4.1 General
7.4.2 Function discovery queries
7.4.3 Function discovery API operations
7.5 Supported protocols
8 NBMP descriptors
8.1 Scheme descriptor
8.1.1 General
8.1.2 JSON schema
8.2 General descriptor
8.2.1 General
8.2.2 JSON schema
8.3 Input descriptor
8.3.1 General
8.3.2 JSON schema
8.3.3
8.3.3 General
8.3.4 JSON schema
8.4 Processing descriptor
8.4.1 General
8.4.2 JSON schema
8.5 Requirements descriptor
8.5.1 General
8.5.2 JSON schema
8.6 Configuration descriptor
8.6.1 General
8.6.2 JSON schema
8.7 Startup-delay descriptor
8.7.1 General
8.7.2 JSON schema
8.8 Client-Assistance descriptor
8.8.1 General
8.8.2 JSON schema
8.9 Failover descriptor
8.9.1 General
8.9.2 JSON schema
8.10 Events descriptor
8.10.1 General
8.10.2 JSON schema
8.11 Variables descriptor
8.11.1 General
8.11.2 JSON schema
8.12 Monitoring descriptor
8.12.1 General
8.12.2 JSON schema
8.13 Reporting descriptor
8.13.1 General
8.13.2 JSON schema
8.14 Notification descriptor
8.14.1 General
8.14.2 JSON schema
8.15 Assertion descriptor
8.15.1 General
8.15.2 JSON schema
8.16 Request Descriptor
8.16.1 General
8.16.2 JSON schema
8.17 Acknowledge descriptor
8.17.1 General
8.17.2 JSON schema
8.18 Repository descriptor
8.18.1 General
8.18.2 JSON schema
8.19 Security descriptor
8.19.1 General
8.19.1 JSON schema
8.20 Step descriptor
8.20.1 General
8.20.2 JSON schema
9 NBMP parameters
9.1 General
9.2 Scheme descriptor parameters
9.3 General descriptor parameters
9.4 Input descriptor parameters
9.5 Output descriptor parameters
9.6 Processing descriptor parameters
9.7 Requirements descriptor parameters
9.7.1 Flow control parameters
9.7.2 Hardware parameters
9.7.3 Security requirements
9.7.4 Workflow/task requirements
9.7.5 Resource estimator parameters
9.8 Startup-Delay descriptor parameters
9.9 Client-Assistant parameters
9.10 Failover parameters
9.11 Events parameters
9.12 Variables parameters
9.13 Monitoring parameters
9.14 Reporting parameters
9.15 Notification parameters
9.16 Assertion parameters
9.17 Request parameters
9.18 Acknowledge parameters
9.19 Repository parameters
9.20 Security parameters
9.21 Step Descriptor parameters
9.22 Configuration descriptor parameters
9.22.1 Generic parameter representation
9.22.2 Example of parameter representation
10 Workflow manager, task and function repository requirements
10.1 Workflow manager requirements
10.2 Function repository requirements
10.3 Task requirements
11 NBMP support for media formats and metadata
11.1 General
11.2 Media formats
11.3 Application formats
11.4 Metadata formats
12 Security considerations in NBMP
12.1 Overview
12.2 Secure and authenticated channels between NBMP source and NBMP workflow manager
12.2.1 General
12.2.2 Secure communication channel between NBMP source and NBMP workflow manager
12.2.3 NBMP source authentication to workflow manager
12.2.4 Workflow manager authentication to NBMP source
12.2.5 Secure channels for task communication
12.2.6 NBMP source authentication/authorization to workflow task
12.2.7 Workflow task authentication to NBMP source
12.2.8 Secure channel for NBMP source and task communication
12.2.9 MPE security
12.2.10 Network security
Annex A (normative) JSON schemas
A.1 General
Annex B (normative) NBMP workflow management
B.1 Description of workflow management
B.2 NBMP workflow management
B.2.1 NBMP workflow creation
B.2.2 NBMP workflow update
Annex C (informative) Schema for identifying MPEG compatible functions
C.1 General
C.2 Identifier schema
Annex D (normative) NBMP MIME types
D.1 General
D.2 MIME type and subtype for WDD
D.3 MIME type and subtype for TDD
D.4 MIME type and subtype for FDD
Annex E (informative) Interface for managing function descriptions in function repository
E.1 General
E.2 Function description management API
Bibliography
Blank Page
Keep me up-to-date
Sign up to receive updates when there are changes to this standard
Related Information
Similar Standards
-
BS EN 61937-10:2011
Digital audio. Interface for non-linear PCM encoded audio bitstreams applying IEC 60958, Non-linear PCM bitstreams according to the MPEG-4 Audio Lossless Coding (ALS) format
-
BS EN 61937-5:2006
Digital audio. Interface for non-linear PCM encoded audio bitstreams applying IEC 60958, Non-linear PCM bitstreams according to the DTS (digital theatre systems) format(s)
-
BS EN 61937-6:2006+A1:2014
Digital audio. Interface for non-linear PCM encoded audio bitstreams applying IEC 60958, Non-linear PCM bitstreams according to the MPEG-2 AAC and MPEG-4 AAC formats
-
BS EN 61937-8:2007
Digital audio. Interface for non-linear PCM encoded audio bitstreams applying IEC 60958, Non-linear PCM bitstreams according to the Windows Media Audio (WMA) Professional format
Foreword
Introduction
1 Scope
2 Normative references
3 Terms, definitions and abbreviated terms
3.1 Terms and definitions
3.2 Abbreviated terms
4 Conventions
5 Overview
5.1 General
5.2 Architecture
5.3 NBMP workflow
5.3.1 General
5.3.2 Workflow processing model
5.3.3 Task allocation and distribution
5.3.4 Workflow graph
5.4 Relationship between logical definitions, data objects and REST resources
5.5 Description of the defined entities in this document
5.5.1 NBMP APIs
5.5.2 Content format
5.5.3 Definitions
5.5.4 Functional behaviour
6 NBMP descriptions
6.1 NBMP function description (FD)
6.1.1 General
6.1.2 Description
6.1.3 Function group
6.1.3.1 General
6.1.3.2 Example
6.1.3.3 Requirements
6.2 NBMP task description (TD)
6.2.1 General
6.2.2 Description
6.2.2 Task lifecycle
6.3 NBMP workflow description (WD)
6.3.1 General
6.3.2 Description
6.3.3 Workflow lifecycle
7 NBMP interfaces
7.1 General
7.2 Workflow APIs
7.2.1 General
7.2.2 Workflow resources
7.2.3 Workflow API operations
7.3 Task APIs
7.3.1 General
7.3.2 Task resource
7.3.3 Task API operations
7.4 Function discovery APIs
7.4.1 General
7.4.2 Function discovery queries
7.4.3 Function discovery API operations
7.5 Supported protocols
8 NBMP descriptors
8.1 Scheme descriptor
8.1.1 General
8.1.2 JSON schema
8.2 General descriptor
8.2.1 General
8.2.2 JSON schema
8.3 Input descriptor
8.3.1 General
8.3.2 JSON schema
8.3.3
8.3.3 General
8.3.4 JSON schema
8.4 Processing descriptor
8.4.1 General
8.4.2 JSON schema
8.5 Requirements descriptor
8.5.1 General
8.5.2 JSON schema
8.6 Configuration descriptor
8.6.1 General
8.6.2 JSON schema
8.7 Startup-delay descriptor
8.7.1 General
8.7.2 JSON schema
8.8 Client-Assistance descriptor
8.8.1 General
8.8.2 JSON schema
8.9 Failover descriptor
8.9.1 General
8.9.2 JSON schema
8.10 Events descriptor
8.10.1 General
8.10.2 JSON schema
8.11 Variables descriptor
8.11.1 General
8.11.2 JSON schema
8.12 Monitoring descriptor
8.12.1 General
8.12.2 JSON schema
8.13 Reporting descriptor
8.13.1 General
8.13.2 JSON schema
8.14 Notification descriptor
8.14.1 General
8.14.2 JSON schema
8.15 Assertion descriptor
8.15.1 General
8.15.2 JSON schema
8.16 Request Descriptor
8.16.1 General
8.16.2 JSON schema
8.17 Acknowledge descriptor
8.17.1 General
8.17.2 JSON schema
8.18 Repository descriptor
8.18.1 General
8.18.2 JSON schema
8.19 Security descriptor
8.19.1 General
8.19.1 JSON schema
8.20 Step descriptor
8.20.1 General
8.20.2 JSON schema
9 NBMP parameters
9.1 General
9.2 Scheme descriptor parameters
9.3 General descriptor parameters
9.4 Input descriptor parameters
9.5 Output descriptor parameters
9.6 Processing descriptor parameters
9.7 Requirements descriptor parameters
9.7.1 Flow control parameters
9.7.2 Hardware parameters
9.7.3 Security requirements
9.7.4 Workflow/task requirements
9.7.5 Resource estimator parameters
9.8 Startup-Delay descriptor parameters
9.9 Client-Assistant parameters
9.10 Failover parameters
9.11 Events parameters
9.12 Variables parameters
9.13 Monitoring parameters
9.14 Reporting parameters
9.15 Notification parameters
9.16 Assertion parameters
9.17 Request parameters
9.18 Acknowledge parameters
9.19 Repository parameters
9.20 Security parameters
9.21 Step Descriptor parameters
9.22 Configuration descriptor parameters
9.22.1 Generic parameter representation
9.22.2 Example of parameter representation
10 Workflow manager, task and function repository requirements
10.1 Workflow manager requirements
10.2 Function repository requirements
10.3 Task requirements
11 NBMP support for media formats and metadata
11.1 General
11.2 Media formats
11.3 Application formats
11.4 Metadata formats
12 Security considerations in NBMP
12.1 Overview
12.2 Secure and authenticated channels between NBMP source and NBMP workflow manager
12.2.1 General
12.2.2 Secure communication channel between NBMP source and NBMP workflow manager
12.2.3 NBMP source authentication to workflow manager
12.2.4 Workflow manager authentication to NBMP source
12.2.5 Secure channels for task communication
12.2.6 NBMP source authentication/authorization to workflow task
12.2.7 Workflow task authentication to NBMP source
12.2.8 Secure channel for NBMP source and task communication
12.2.9 MPE security
12.2.10 Network security
Annex A (normative) JSON schemas
A.1 General
Annex B (normative) NBMP workflow management
B.1 Description of workflow management
B.2 NBMP workflow management
B.2.1 NBMP workflow creation
B.2.2 NBMP workflow update
Annex C (informative) Schema for identifying MPEG compatible functions
C.1 General
C.2 Identifier schema
Annex D (normative) NBMP MIME types
D.1 General
D.2 MIME type and subtype for WDD
D.3 MIME type and subtype for TDD
D.4 MIME type and subtype for FDD
Annex E (informative) Interface for managing function descriptions in function repository
E.1 General
E.2 Function description management API
Bibliography
Blank Page