Changelog
All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
5.1.3 - 2024-03-21
Fix
- npm publish issues.
5.1.2 - 2023-10-16
Features
- Upgrade @vonage/media-processor to version 2.0.4
5.1.2 - 2023-10-16
Fix
- Fix remanent background regression in 5.1.1.
5.1.1 - 2023-10-5
Fix
- Fix image/video preloading while setting background options.
5.1.0 - 2023-8-22
Features
- Enable/Disable function on VonageMediaProcessor.
Fix
- Fix a bug preventing processor to be used after worker being destroyed
5.0.1 - 2023-3-29
Features
- Upgrade @vonage/media-processor to version 2.0.3
- Upgrade @vonage/js-workerizer to version 1.1.2
- Upgrade @vonage/js-onewebrtc-telemetry to version 1.1.2
5.0.0 - 2023-2-23
Added
- New rendering pipeline using canvas 2d. See documentation for more details. https://vonage.github.io/ml-transformers-docs/docs/renderers
Changed
- selfieSegmentationType is now part of renderingOptions and is not a field of the config anymore.
4.3.6 - 2023-2-17
Added
- Added a check where an error will be thrown if a unknown transformer type is requested.
4.3.5 - 2023-2-9
Added
- The library now logs background transformer create and update events if metadata is set with setVonageMetadata. The infos logged allow Vonage to measure performances of the different filters in order to improve them.
4.3.4 - 2023-1-26
Fixed
- Fix SelfieSegmentationType and BackgroundTransformerType missing from the exposed symbols.
4.3.3 - 2023-1-11
Fixed
- Fix new VideoFrame timestamp in order to prevent syncing issue between audio and video.
4.3.2 - 2022-12-7
Fixed
- Fix background option runtime change for blur config.
4.3.1 - 2022-11-25
Added
- New profile function on media processor. It will download a stacktrace of the gpu programs. This file is compatible with https://www.speedscope.app/
Changed
- Blur downscale its input by a factor of 8 before processing in order to improve performance.
4.3.0 - 2022-11-24
Added
- Add webgl support check to isSuppported and getSupportedBrowserFeatures
4.2.1 - 2022-11-23
Fixed
- Fixing a webpack umd bundling capabilities when the library was used within another lib.
4.2.0 - 2022-11-7
Added
- New function getSupportedBrowserFeatures providing a more detailled overview of what features is supported by the browser
Changed
- New optional parameters wasmAssetUriPath and tfliteAssetUriPath to getSupported function allowing specifying which tflite/wasm path.
4.1.0 - 2022-11-4
Added
- BackgroundTransformer transformer is exposed by the library so it can now be imported directly and used as a regular transformer.
4.0.1 - 2022-10-20
Fixed
- Fix vitual background loading if the initial config was using it.
4.0.0 - 2022-10-20
Added
- Full library documentation. Here.
- Export list updated.
- New option 'selfieSegmentationType' in the BackgroundOption.
Fixed
- Memory leak while switching filter is now fixed.
Enhancements
- Rendering is processing using WebGL.
- SelfieSegmentation used for background filter is running on a WebWorker.
Changed
- New postprocessing filter on the selfie segmentation which reduce flickering. This process is enable by default for virtual background and video background. Could be disabled/enabled for all background filters using the option 'selfieSegmentationType'.
- MediaPipe metadata objects exports changed to functions export.
- Type
MediaPipeModelType
changed to enum. - createVonageMediaProcessorConnector, getVonageEventEmitter, setTrackExpectedRate and setBackgroundOptions removed. Use createVonageMediaProcessor instead.
Deprecated
- NA
3.2.0 - 2022-10-11
Added
- New class VonageMediaProcessor
Fixed
- This version includes changes made in the context of ticket where fixing the error of creating more then one MediaProcessorConnectorInterface.
Enhancements
- NA
Changed
- NA
Deprecated
- createVonageMediaProcessorConnector
- createVonageMediaProcessorConnector
- getVonageEventEmitter
- setTrackExpectedRate
- setBackgroundOptions
3.1.1 - 2022-08-30
Added
- NA
Fixed
- This version includes changes made in the context of ticket where more improvements and tweaks were added in order to improve the viewing experience when blurring.
- This version includes changes made in the context of ticket cross origin source fix.
Enhancements
- NA
Changed
- NA
Deprecated
- NA
3.1.0 - 2022-08-01
Added
- Option to set blur radius as a number.
Fixed
- Fixes bug where new tweaks are applied in order to improve image quality and the overall viewing experience when blurring.
Enhancements
- NA
Changed
- NA
Deprecated
- NA
3.0.0 - 2022-06-29
Added
- New Vonage Mediapipe objects:
- VonageSelfiesegmentation
- VonageHands
- VonageHolistic
- VonageFacedetection
- VonageFacemash
- VonageObjectron
- VonagePose
Fixed
- Fixes bug where all library properties added to the window object in previous versions are now removed.
Enhancements
- NA
Changed
- NA
Deprecated
- NA
2.0.4 - 2022-06-27
Added
- NA
Fixed
- Fixes bug where a call to destroy the media processor could not resolve when destroying the media stream track instance before.
Enhancements
- NA
Changed
- NA
Deprecated
- NA
2.0.3 - 2022-06-22
Added
- NA
Fixed
- bug:
Enhancements
- NA
Changed
- NA
Deprecated
- NA
2.0.2 - 2022-06-20
Added
- NA
Fixed
- bug:
Enhancements
- NA
Changed
- NA
Deprecated
- NA
2.0.1 - 2022-06-13
Added
- Change post process background operations without restarting the module. https://vonage.github.io/ml-transformers-docs/modules.html#setBackgroundOptions
Full integration of MediaPipe:
- Face Detection
- Face Mesh
- Hands
- Holistic
- Objectron
- Pose
- Selfie Segmentation (already used by the library for background processes)
Added static assets for each MediaPipe model on S3 behind could front CDN (supports CORS)
Please refer this warning https://vonage.github.io/ml-transformers-docs/modules.html#MediaPipeModelConfig about assetsUri
Face Detection: https://d3opqjmqzxf057.cloudfront.net/ml/mediapipe/face_detection/0.4.1646425229
- face_detection_full_range_sparse.tflite
- face_detection_full_range.tflite
- face_detection_full.binarypb
- face_detection_short_range.tflite
- face_detection_short.binarypb
- face_detection_solution_simd_wasm_bin.js
- face_detection_solution_simd_wasm_bin.wasm
- face_detection_solution_wasm_bin.js
- face_detection_solution_wasm_bin.wasm
Face Mesh: https://d3opqjmqzxf057.cloudfront.net/ml/mediapipe/face_mesh/0.4.1633559619
- face_mesh_solution_packed_assets_loader.js
- face_mesh_solution_packed_assets.data
- face_mesh_solution_simd_wasm_bin.js
- face_mesh_solution_simd_wasm_bin.wasm
- face_mesh_solution_wasm_bin.js
- face_mesh_solution_wasm_bin.wasm
- face_mesh.binarypb
Hands: https://d3opqjmqzxf057.cloudfront.net/ml/mediapipe/hands/0.4.1646424915
- hand_landmark_full.tflite
- hand_landmark_lite.tflite
- hands_solution_packed_assets_loader.js
- hands_solution_packed_assets.data
- hands_solution_simd_wasm_bin.js
- hands_solution_simd_wasm_bin.wasm
- hands_solution_wasm_bin.js
- hands_solution_wasm_bin.wasm
- hands.binarypb
Holistic: https://d3opqjmqzxf057.cloudfront.net/ml/mediapipe/holistic/0.5.1635989137
- holistic_solution_packed_assets_loader.js
- holistic_solution_packed_assets.data
- holistic_solution_simd_wasm_bin.js
- holistic_solution_simd_wasm_bin.wasm
- holistic_solution_wasm_bin.js
- holistic_solution_wasm_bin.wasm
- holistic.binarypb
- pose_landmark_full.tflite
- pose_landmark_heavy.tflite
- pose_landmark_lite.tflite
Objectron: https://d3opqjmqzxf057.cloudfront.net/ml/mediapipe/objectron/0.4.1636596145
- object_detection_3d_camera.tflite
- object_detection_3d_chair.tflite
- object_detection_3d_cup.tflite
- object_detection_3d_sneakers.tflite
- objectron_solution_packed_assets_loader.js
- objectron_solution_packed_assets.data
- objectron_solution_simd_wasm_bin.js
- objectron_solution_simd_wasm_bin.wasm
- objectron_solution_wasm_bin.js
- objectron_solution_wasm_bin.wasm
- objectron.binarypb
Pose: https://d3opqjmqzxf057.cloudfront.net/ml/mediapipe/pose/0.5.1635988162
- pose_landmark_full.tflite
- pose_landmark_heavy.tflite
- pose_landmark_lite.tflite
- pose_solution_packed_assets_loader.js
- pose_solution_packed_assets.data
- pose_solution_simd_wasm_bin.js
- pose_solution_simd_wasm_bin.wasm
- pose_solution_wasm_bin.js
- pose_solution_wasm_bin.wasm wasm
- pose_web.binarypb
Selfie Segmentation: https://d3opqjmqzxf057.cloudfront.net/ml/mediapipe/selfie_segmentation/0.1.1632777926
- selfie_segmentation_landscape.tflite
- selfie_segmentation_solution_simd_wasm_bin.js
- selfie_segmentation_solution_simd_wasm_bin.wasm
- selfie_segmentation_solution_wasm_bin.js
- selfie_segmentation_solution_wasm_bin.wasm
- selfie_segmentation.binarypb
- selfie_segmentation.tflite
Public documentation at https://vonage.github.io/ml-transformers-docs/index.html
Fixed
- Workers destruction at end of process.
- Permormance improvements in 40% less CPU usage of all post processe operations.
- MediaPipe uses WebGL to create the segmentation ImageBitmap.
- All processes use ImageBitmap which have very good performance on Web workers.
- For more information about the integration between the Web worker and the main thread you can check the code here at https://github.com/Vonage/ml-transformers/tree/main/lib/src/vonage.
- Fixed bugs.
Enhancements
- NA
Changed
- Update Vonage/media-processor version to v1.2.7 (from v1.2.1) see release notes: https://github.com/Vonage/media-processor/blob/main/CHANGELOG.md
- Config object was changed. https://vonage.github.io/ml-transformers-docs/modules.html#MediaProcessorBaseConfig
Deprecated
- NA
1.3.1 - 2022-03-31
Added
- NA
Fixed
Re-names of functions:
getMetadata
->getVonageMetadata
setMetadata
->setVonageMetadata
Enhancements
- NA
Changed
- NA
Deprecated
- NA
1.2.1 - 2022-03-31
Added
- NA
Fixed
- Fix
setMetaData
setting option. now if not callingsetMetaData
stats will not be sent. When callingsetMetaData({'appId' : '123', sourceType: 'test'})
stats will be sent.
Enhancements
- NA
Changed
- NA
Deprecated
- NA
1.2.0 - 2022-03-15
Added
- ML-Transformer implements an async event emitter pattern. for error and warn
- setTrackExpectedRate - Allow the user to set the expected rate of the track. An warn will be emit when 20% drop of the expected rate of the track.
Fixed
- Add support to set uri for wasm and tflite assets.
Enhancements
- NA
Changed
- NA
Deprecated
- NA
1.1.0 - 2022-03-09
Added
- NA
Fixed
- Add support to set uri for wasm and tflite assets.
Enhancements
- NA
Changed
- NA
Deprecated
- NA
1.0.0 - 2022-03-08
Added
- First GA library version.
Fixed
- NA
Enhancements
- NA
Changed
- NA
Deprecated
- NA