自制红外遥控头iphone
by James Hsu
由徐H
iPhone X的TrueDepth红外摄像头:除了Animoji和Face ID之外的可能性无限 (The iPhone X’s TrueDepth IR Camera: A Universe of Possibilities Beyond Animojis and Face ID)
More than two months after the iPhone X launch, it remains a conundrum for some to put a finger on exactly which features might justify the $1000+ price Apple has given its flagship phone.
iPhone X推出两个多月后,对于某些人来说,确切地指出哪些功能可以证明苹果为其旗舰手机提供的1000美元以上的价格是合理的,这仍然是一个难题。
Some might wager on the virtually edge-to-edge OLED display, which for the first time on an iPhone, does away with the tactile home button and prominent top and bottom bezels of every previous model. It is admittedly gorgeous.
有些人可能会在几乎完全是边缘到边缘的OLED显示器上押注,这在iPhone上是第一次,它取消了以前每个型号的触摸式主页按钮以及突出的上下边框。 无疑是华丽的 。
As it turns out, however, the iPhone X’s most groundbreaking feature is not even discernible at first glance, even though it literally stares you in the face.
然而,事实证明,iPhone X最具突破性的功能即使乍看之下也无法一眼看出。
认识TrueDepth红外热像仪 (Meet the TrueDepth IR Camera)
Apple has been dogged by perceptions that the company’s product roadmap has grown conservative and predictable in the six years following Steve Jobs’ passing. The new TrueDepth IR camera, as Apple calls the iPhone X’s secondary front-facing camera, could well help Apple dispel those rumors of complacency.
苹果公司一直对苹果的产品路线图在史蒂夫·乔布斯逝世后的六年中变得保守且可预测的看法感到困惑 。 苹果称其为iPhone X的次要前置摄像头的新型TrueDepth红外热像仪可以很好地帮助苹果消除那些自满的谣言。
New to the iPhone X and housed in the black notch at the top of the display, the technology includes a number of high tech components such as a “flood illuminator,” infrared (IR) camera, and an infrared emitter. The latter emits 30,000 infrared dots in a known pattern when a face is detected, enabling the iPhone X to generate a 3D map of a user’s face. Notably, the TrueDepth IR camera can do this fast enough to support the creation of 3D motion data as well.
iPhone X的新功能是位于显示屏顶部的黑色凹槽中,该技术包括许多高科技组件,例如“泛光照明器”,红外(IR)相机和红外发射器。 当检测到面部时,后者会以已知的模式发射30,000个红外点,从而使iPhone X能够生成用户面部的3D地图。 值得注意的是,TrueDepth红外热像仪可以足够快地执行此操作,以支持创建3D运动数据。
目前,iPhone X上新的TrueDepth红外摄像头当前有两个受支持的用例: (At present, there are currently two supported use cases for the new TrueDepth IR camera on the iPhone X:)
Animoji, or animated emoji — the camera animates a 3D emoji with your captured facial expressions, which you can then send via Messenger or SMS.
Animoji或动画表情符号-相机使用捕获的面部表情为3D表情符号设置动画,然后可以通过Messenger或SMS发送表情符号。
Face ID — the camera uses a locally stored 3D image of your face to authenticate and unlock your iPhone X. Because it uses 3D image data, it’s much harder to trick than previous mobile face recognition systems that used a 2D image and therefore could be fooled with a photo.
面部识别码 -相机使用本地存储的面部3D图像进行身份验证和解锁iPhoneX。由于它使用3D图像数据,因此比以前使用2D图像的移动面部识别系统更难欺骗,因此可能会被骗和一张照片。
“什么-就是吗?” (“What — that’s it?”)
Admittedly, the current use cases for this technology are limited.
诚然,该技术的当前用例是有限的。
Animoji are just emoji with a fun twist, and unlocking phones hasn’t exactly been a pain point for modern smartphone users, with the prevalence of fingerprint sensors on many phones and pattern drawing as an adequate secondary option.
Animoji只是带有有趣变化的表情符号,对于现代智能手机用户而言,解锁手机并不是真正的痛苦点,许多手机上都普遍使用指纹传感器,并且将图案绘制作为次要的选择。
What’s incredibly intriguing is that the TrueDepth IR camera technology can and will have much stronger applications in the very near future. As with the iPhone’s previous Touch ID (fingerprint sensor), an iOS SDK makes it easy for app developers to use Face ID and the TrueDepth IR camera for a myriad of other more compelling use cases. In fact, Face ID uses the exact same API as Touch ID, making implementation into mobile apps incredibly simple.
令人难以置信的是,在不久的将来,TrueDepth红外热像仪技术可以而且将具有更强大的应用。 与iPhone以前的Touch ID(指纹传感器)一样,iOS SDK使应用程序开发人员可以在众多其他更引人注目的用例中轻松使用Face ID和TrueDepth红外摄像头。 实际上,Face ID使用与Touch ID完全相同的API,这使得在移动应用中的实现变得异常简单。
Here are some of the areas where the TrueDepth IR camera could spawn useful or interesting mobile applications:
以下是TrueDepth红外热像仪可能产生有用或有趣的移动应用程序的一些区域:
金融服务和网上银行 (Financial Services and Internet Banking)
For more than a decade, the gold standard in Internet banking authentication has been two-factor authentication. One of the most common forms of two-factor authentication has involved sending a verification code sent to your phone or email address, which must then be manually entered along with your password to access your account.
十多年来,网上银行认证的金标准一直是两因素认证。 两因素身份验证的最常见形式之一是将验证码发送到您的电话或电子邮件地址,然后必须将其与密码一起手动输入以访问您的帐户。
In the past few years, mobile banking apps have been quick to add support for fingerprint-based authentication. This has made it easier than ever to access your bank accounts online using your mobile phone. For the banks, this means customers have easier access to their services, resulting in increased revenues.
在过去的几年中,移动银行应用程序Swift增加了对基于指纹的身份验证的支持。 这使使用手机在线访问银行帐户比以往更加容易。 对于银行而言,这意味着客户可以更轻松地使用其服务,从而增加收入。
Why, given the already enhanced convenience of fingerprint-based authentication, would banks care about implementing face recognition into their mobile apps? To understand why, let’s consider false positive rates — the rate at which any given authentication protocol provides a false authentication. Apple claims that Touch ID, its fingerprint based authentication, has a false positive rate of 1 in 50,000. Compare that to the chance of guessing a four-digit PIN, 1 in 10,000.
鉴于已经提高了基于指纹的身份验证的便利性,为什么银行会关心在其移动应用程序中实现人脸识别? 为了理解原因,让我们考虑误报率-任何给定的身份验证协议提供误报的速率。 苹果公司声称,Touch ID(其基于指纹的身份验证)的误报率为50,000分之一。 将其与猜测四位数PIN(每10,000个中的一个)的机会进行比较。
Now, let’s look at the iPhone X’s new Face ID feature. Apple claims Face ID has a false positive rate of approximately 1 in 1,000,000. If true, this represents a 20-fold improvement in accuracy compared to fingerprint based authentication and 100-fold improvement over a four-digit PIN.
现在,让我们看一下iPhone X的新Face ID功能。 苹果声称Face ID的误报率约为1,000,000分之一。 如果为true,则表示与基于指纹的身份验证相比,准确性提高了20倍,与四位数PIN相比,提高了100倍。
That’s sure to get the attention of the banks offering Internet banking, as well as of the consumers who also benefit from enhanced fraud protection. In fact, many banks have already implemented Face ID support into their iOS apps. Chase, for example, added Face ID support within two weeks of the iPhone X’s launch.
这肯定会引起提供网上银行服务的银行以及也从增强的欺诈保护中受益的消费者的关注。 实际上,许多银行已经在其iOS应用程序中实现了Face ID支持。 例如,Chase 在iPhone X推出的两周内增加了Face ID支持 。
娱乐与娱乐 (Entertainment and Fun)
iOS 11 introduced ARKit, a new framework that allows developers to easily create unparalleled augmented reality experiences for iPhone and iPad. Combined with the iPhone X’s TrueDepth IR camera, ARKit opens up a revolutionary capability for robust face tracking across multiple app categories.
iOS 11引入了ARKit ,这是一个新框架,使开发人员可以轻松地为iPhone和iPad创建无与伦比的增强现实体验。 结合iPhone X的TrueDepth红外摄像头,ARKit开启了一项革命性的功能,可在多个应用类别中进行可靠的人脸跟踪。
Imagine:
想像:
- Entering the character creation screen for Assassin’s Creed: Identity and being able to not only choose your assassin’s class but also their visual identity, using your own face in place of the default character model’s 进入“刺客信条:身份”的角色创建屏幕,不仅可以使用自己的面Kong代替默认角色模型的表情,还可以选择刺客的职业,还可以选择其视觉形象。
- Having a more accurate view of a prospective match’s face before you choose to swipe left or swipe right on Tinder, Bumble, or POF 在选择在Tinder,Bumble或POF上向左或向右滑动之前,可以更准确地查看预期比赛的面Kong
- Being able to skip a trip to Sephora or ULTA and experiment with new makeup without shelling out for everything up front 能够跳过丝芙兰或ULTA的旅程并尝试新妆容,而无需花很多钱在前面
A few years ago, virtual reality (VR) technology was in the same place that the technology behind TrueDepth IR is now: a promising technology needing stronger applications in video games and entertainment.
几年前,虚拟现实(VR)技术与现在的TrueDepth IR所处的技术处于同一位置:一项有前途的技术,需要在视频游戏和娱乐中得到更强大的应用。
Oculus, a virtual reality company, was founded in 2012 and ran a successful Kickstarter campaign that year, raising $2.5 million. Just two years later in 2014, Oculus was acquired by Facebook for $2 billion, or nearly one thousand times the initial financing round. Could companies that invest in entertainment applications using TrueDepth IR technology find a similar trajectory?
Oculus是一家虚拟现实公司,成立于2012年,并于当年成功举办了Kickstarter活动,筹集了250万美元。 仅两年后的2014年,Oculus被Facebook以20亿美元的价格收购 ,几乎是最初一轮融资的1000倍。 使用TrueDepth IR技术投资娱乐应用程序的公司能否找到类似的轨迹?
There are already precedents in the space, too. Two years ago — when face tracking was still based on two-dimensional images — Facebook purchased (for an undisclosed amount) Masquerade, a startup whose MSQRD app lets users create self-altered images and video using face tracking technology.
这个领域也已经有先例。 两年前-当人脸追踪仍基于二维图像时-Facebook 购买了(金额不详)Masquerade ,这是一家初创公司,其MSQRD应用程序可让用户使用人脸追踪技术创建自行更改的图像和视频。
医疗与健身 (Medical and Fitness)
Imagine being able to have a medical examination at any hour of the day, on-demand, from the convenience of your bed, sofa, or office chair. With the help of the iPhone X’s TrueDepth IR camera, this could become a reality.
想象一下,在一天中的任何时候都可以通过床,沙发或办公椅的便利随时进行身体检查。 借助iPhone X的TrueDepth红外摄像头,这可能成为现实。
TrueDepth IR technology has the potential to be used for medical imaging, because it can create detailed 3D maps of your face, including the surface of your skin. Notably, it can also capture 3D movement, including subtle changes in facial expression.
TrueDepth红外技术具有用于医学成像的潜力,因为它可以创建面部(包括皮肤表面)的详细3D地图。 值得注意的是,它还可以捕获3D运动,包括面部表情的细微变化。
Consider the following potential medical use cases:
考虑以下潜在的医疗用例:
- Have a dermatologist examine an abnormal skin growth, with the ability to rotate the image for a better look at the structure of a potential tumor, for example. 例如,让皮肤科医生检查皮肤异常生长,并具有旋转图像的能力,以便更好地查看潜在肿瘤的结构。
- Have your phone automatically alert you when it notices facial cues or subtle movements that could be associated with the onset of a stroke, seizure, or heart attack. 让手机在发现可能与中风,癫痫发作或心脏病发作有关的面部提示或微妙动作时自动提醒您。
- For recovering stroke patients, you might have an app that tracks any muscular degeneration over time and provides your doctors with this detailed 3D image data on demand. 为了使中风患者康复,您可能需要使用一个可跟踪随时间推移发生的肌肉变性的应用程序,并根据需要向医生提供此详细的3D图像数据。
While these use cases would certainly not replace the need to have in-person examinations, regular screening via phone camera could play a supporting role in enabling early detection or regular monitoring of known medical conditions.
尽管这些用例肯定不能代替亲自检查的需求,但通过电话摄像头进行定期检查可以在对已知医疗状况进行早期检测或定期监测方面发挥辅助作用。
Consider also that Apple has published a software development kit (SDK) called Apple Healthkit, which allows app developers API access to rich health and fitness information across a variety of sources: fitness wearables, health devices, and software applications. New or updated mobile apps might combine health vitals from Apple Healthkit with 3D facial image data to offer a more complete assessment of users’ health or fitness.
还考虑一下Apple已发布了一个名为Apple Healthkit的软件开发工具包(SDK),它允许应用程序开发人员API通过各种来源访问丰富的健康和健身信息:健身可穿戴设备,健康设备和软件应用程序。 新的或更新的移动应用程序可能会将Apple Healthkit的健康要素与3D面部图像数据结合起来,以提供对用户的健康状况或健康状况的更完整评估。
未来就在这里 (The Future is Here)
The iPhone X is the first phone to offer depth-sensing IR cameras, but it certainly won’t be the last.
iPhone X是第一款提供深度感应红外摄像头的手机,但肯定不会是最后一款。
“With the wide spectrum of new use cases that the technology makes possible, the impetus is now on software developers and bold businesses to bring these applications to life,” said Harry Lee, CEO of CitrusBits. Based in Los Angeles and San Francisco, CitrusBits is a mobile app development agency that designs and develops award-winning mobile apps for some of the world’s best known brands, including Burger King, Symantec, and Quiksilver.
CitrusBits首席执行官哈里·李(Harry Lee)表示:“随着该技术所带来的广泛的新用例,现在推动了软件开发人员和大胆的企业将这些应用程序变为现实的动力 。” CitrusBits总部位于洛杉矶和旧金山,是一家移动应用程序开发公司,为汉堡王,赛门铁克和Quiksilver等一些世界上最知名的品牌设计和开发屡获殊荣的移动应用程序。
“Those that do embrace the technology now can enjoy first mover advantages such as the ability to build a sizable market share and enjoy strong network effects that discourage future market entrants — not to mention the opportunity to get bought up by Facebook, Microsoft, or another titan of industry,” Lee explains.
“那些确实接受这项技术的人现在可以享受先发优势,例如能够建立可观的市场份额并享受强大的网络效应,这会阻止未来的市场进入者,更不用说被Facebook,微软或其他公司收购的机会了。工业巨人”, 李解释。
To see more stories like this one, subscribe to CitrusBits’ newsletter, Bits & Bytes.
要查看更多类似的故事,请订阅CitrusBits的时事通讯Bits&Bytes 。
自制红外遥控头iphone