ARCore – 来自后置 Android 深度摄像头的原始深度数据

问题描述

我不知道如何从带有后置 ToF 深度传感器的小米红米 Note 8 Pro 获取原始深度数据.

我试过了:

• 来自

  
  

  从现在开始，ARCore 开发人员可以使用原始深度 API 进行精确测量和重构网格的操作.另一方面，Full Depth API 非常适合用于人物/物体遮挡和场景重新照明目的.

  下表比较了三个重要参数:

  |------------|------------|--------------------|||原始深度 API"|全深度API"||------------|------------|-------------------||精度 |真棒|坏 ||------------|------------|-------------------||覆盖范围|并非所有像素|所有像素 ||------------|------------|-------------------||距离 |0.5 到 5.0 m |0 到 8.0 米 ||------------|------------|-------------------|

  ARCore Depth API 支持的设备的列表不断增加.请注意名为 Comments 的最后一栏 - 有关深度 API 支持的信息.

  I can't figure out how can I get raw depth data from my Xiaomi Redmi Note 8 Pro with rear ToF depth sensor.

  I've tried:

  • Camera2Format from android samples. No results (and I'm not alone)
  • get physicalId from rear camera as described in android developers blog. No result.
  • ARCore API can't handle depth.

  I saw several similar questions (one, two) without answers. Is it so difficult to capture raw depth from depth camera in Android?

  解决方案

  Raw Depth API vs Full Depth API

  A few days ago, at Google IO 2021, a new API for ARCore 1.24 was announced – Raw Depth API to addition to existing Full Depth API announced for ARCore 1.18. This brand new API gives you the ability to use Raw Depth data coming from iToF sensor. This data can be retrieved through 16-bit buffer stream, where 13-bit is reserved for depth map and 3-bit is reserved for confidence map.

  
  

  
  

  From now ARCore developers can use Raw Depth API for Precise Measurements and for ops on Reconstructed Mesh. On the other hand, Full Depth API is ideally suitable for People/Objects Occlusion and Scene Relighting purposes.

  The following table compares three important parameters:

  |------------|--------------------|--------------------|
  |            |  "Raw Depth API"   |  "Full Depth API"  |
  |------------|--------------------|--------------------|
  |  Accuracy  |       Awesome      |         Bad        |
  |------------|--------------------|--------------------|
  |  Coverage  |   Not all pixels   |     All pixels     |
  |------------|--------------------|--------------------|
  |  Distance  |    0.5 to 5.0 m    |     0 to 8.0 m     |
  |------------|--------------------|--------------------|
  

  The list of ARCore Depth API supported devices is growing. Pay attention to the last column called Comments - info about Depth API support is there.

  这篇关于ARCore – 来自后置 Android 深度摄像头的原始深度数据的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持！