AR app with rear camera face anchor
Trying to develop an app with face tracking using the rear camera of an iPad
or iPhone. All documentation available seems to refer only to front camera cases. Am I trying the impossible here?
You can make a difference in the Apple Support Community!
When you sign up with your Apple Account, you can provide valuable feedback to other community members by upvoting helpful replies and User Tips.
When you sign up with your Apple Account, you can provide valuable feedback to other community members by upvoting helpful replies and User Tips.
Trying to develop an app with face tracking using the rear camera of an iPad
or iPhone. All documentation available seems to refer only to front camera cases. Am I trying the impossible here?
While a dual camera back can capture depth, the rear cameras are not TrueDepth so no Face ID nor related support.
Face detection runs a parallel scan using an IR point scan. It’s this point scan that is underneath Face ID.
Well, you could implement face detection support yourself, but that’s a larger (and riskier) ML project than you probably intended to start.
Improve Object Detection models in Create ML - Tech Talks - Videos - Apple Developer
I don’t think AR kit object detection will get you there, either:
And the LIDAR scanner uses a very different hardware design and scan design:
https://www.eyerys.com/articles/how-apples-lidar-sensor-differs-one-its-truedepth-face-id
While a dual camera back can capture depth, the rear cameras are not TrueDepth so no Face ID nor related support.
Face detection runs a parallel scan using an IR point scan. It’s this point scan that is underneath Face ID.
Well, you could implement face detection support yourself, but that’s a larger (and riskier) ML project than you probably intended to start.
Improve Object Detection models in Create ML - Tech Talks - Videos - Apple Developer
I don’t think AR kit object detection will get you there, either:
And the LIDAR scanner uses a very different hardware design and scan design:
https://www.eyerys.com/articles/how-apples-lidar-sensor-differs-one-its-truedepth-face-id
Thank you for the extremely detailed information. I wasn’t fully aware that the LiDAR Scanner and the front face scanner were different hardware design.
It just somehow seemed doable but I guess it’ll have to wait for the AR revolution that the Apple AR device is suppose to bring.
AR app with rear camera face anchor