【更新】Awesome ML Kit 2.2.0
Awesome ML Kit gives Unity developers easy way to employ optimized real-time ML models centered around computer vision.
The current set of models includes
1. High-quality background removal/background matting based on RobustVideoMatting. Optimized for Unity, both horizontal and vertical/portrait video aspect ratio supported
2. Depth estimation by single image
Features
1. Sample scene for each model. Specially made visualizations with different post effects. Additional 3d scene, background blur and glitch scenes
2. Select solid color / image / video as background replacement; put Unity content between foreground & background layers
3. Different model versions for Quality / Speed tradeoff
4. Linear/Gamma color spaces supported
5. WebCamTexture support
6. Unity VideoPlayer integration
7. AVPro Live Camera integration (recommended instead of WebCamTexture)
8. AVPro Video 3 integraion
Ideal for
+ Video processing
+ Media installations
+ Apps with video streaming (e.g. can be used with Agora.io)
+ Kiosks
Performance (barracuda)
NVidia RTX3070
+ Background removal: 300 FPS
+ Depth estimation: 400 FPS
NVidia GTX1050Ti (mobile)
+ Background removal: 50 FPS
+ Depth estimation: 80 FPS
Note: only desktop platforms currently supported (tested on Windows DX11 and Linux Vulkan)
Unity versions: 2021 and above (Unity 6 now supported)
Awesome ML Kit为Unity开发人员提供了一种简单的方法,可以使用以计算机视觉为中心的优化实时ML模型。
当前的模型集包括
1.基于RobustVideoMatting的高质量背景去除/背景遮片。针对Unity进行了优化,支持水平和垂直/纵向视频宽高比
2.单幅图像的深度估计
特征
1.每个模型的示例场景。特别制作的具有不同后期效果的可视化效果。额外的3d场景、背景模糊和故障场景
2.选择纯色/图像/视频作为背景替换;在前景和背景层之间放置Unity内容
3.质量/速度权衡的不同型号版本
4.支持线性/Gamma颜色空间
5.WebCam纹理支持
6.Unity VideoPlayer集成
7.AVPro实时摄像头集成(建议代替WebCamTexture)
8.AVPro Video 3集成
非常适合
+视频处理
+媒体安装
+带有视频流的应用程序(例如,可以与Agora.io一起使用)
+售货亭
表演(梭鱼)
NVidia RTX3070
+背景移除:300 FPS
+深度估计:400 FPS
NVidia GTX1050Ti(移动)
+背景移除:50 FPS
+深度估计:80 FPS
注意:目前仅支持桌面平台(在Windows DX11和Linux Vulkan上测试)
Unity版本:2021及以上(现在支持Unity 6)
页:
[1]