Apple wins patent for a scene camera system for a mixed reality headset that includes a 2D array of cameras

Right this moment, the US Patent and Trademark Workplace has formally granted Apple a patent for a brand new HMD digicam system that features a two-dimensional array of cameras that take footage of particular components of a scene.

Right this moment, the US Patent and Trademark Workplace has formally granted Apple a patent for a brand new HMD digicam system that features a two-dimensional array of cameras that take footage of particular components of a scene.

The cameras are positioned alongside a spherical floor in order that the cameras have adjoining fields of view. The cameras’ entrance pupils are positioned at or close to the person’s eye whereas the cameras additionally kind enhanced pictures on the sensor. Strategies for decreasing the variety of cameras within the matrix are additionally described, in addition to strategies for decreasing the variety of pixels learn from the matrix and processed by the pipeline.

Whereas at this time’s patent report will be appreciated by all Apple followers, the patent shall be particularly appreciated by the engineers, optics engineers, and technologists who go in spite of everything issues VR headsets.

Simulated environments for digital actuality methods and/or combined environments for combined actuality methods can be utilized to supply an interactive person expertise for a number of purposes, reminiscent of purposes that add digital content material to a real-time view of a viewer’s setting, purposes that create 3D digital worlds (Metaverse), and work together with environments Digital coaching, video games, distant management of drones or different mechanical methods, show of digital media content material, interplay with the Web, exploration of landscapes or digital environments, or the like.

Apple’s patent covers scene cameras for video head-mounted shows (HMDs) that can be utilized in combined actuality (MR) or digital actuality (VR) methods.

On conventional HMDs, a number of sight cameras will be mounted to the entrance of the HMD. Nevertheless, the standpoint (POV) of scene cameras is tremendously compensated for and differs from the POV of the person’s eyes. Apple’s invention corrects the standpoint (POV) of cameras to match the person’s POV by shifting the cameras’ entrance pupils towards the person’s eyes.

In some fashions, the HMD contains two-dimensional arrays of small kind issue cameras (for instance, one matrix for the left eye, a second matrix for the appropriate eye) that seize pictures of particular components of a scene from the true world in entrance of the person. The cameras are positioned alongside a curve or spherical floor in order that the cameras have non-overlapping, contiguous fields of view (FOVs).

To realize a extra correct illustration of the person’s perspective, the cameras’ optics are configured in order that the cameras’ entrance pupils are positioned within the matrix behind the cameras’ picture planes shaped on the picture sensors, and at or close to the person. the attention whereas the cameras additionally compose enhanced pictures on the sensor. On this approach, every set of cameras seize views of the scene from the identical perspective because the person’s eye.

In some fashions, one sensor can be utilized to take footage of a number of cameras (for instance, 4) within the matrix. In these fashions, the optics of cameras used with a sensor will be shifted or modified to align picture planes with the sensor floor.

In some embodiments, a curved sensor and easier lens system can be utilized to supply a wider discipline of view for every digicam and thus cut back the variety of cameras within the array.

Apple FIG patent. Determine 1a beneath reveals a head-mounted monitor (HMD) that features an array of cameras with entrance pupils at or close to the person’s eye; Figs. 2 reveals a part of the digicam matrix.

2 patents for HMD 1A 2 . camera

Apple FIG patent. Determine 3 beneath reveals an instance of a digicam with an entrance pupil at or close to the person’s eye that can be utilized in a matrix as proven within the figures. 1a and a couple of.

(Click on on the picture beneath to enlarge)

3 fig.  3 patents for hmd camera

Fig apple. 9A and 9B beneath show decreasing the variety of cameras by lowering decision and shifting the enter pupil of the cameras into the peripheral areas.

4 Apple HMD Patent Camera 9A B 16 17

Apple FIG patent. Determine 16 above graphically reveals the addition of a passive meniscus lens in entrance of the digicam meeting to extend the sphere of view (FOV) for perimeter cameras; Figs. Determine 17 graphically illustrates the addition of a destructive meniscus lens in entrance of the digicam array to steadily compensate the cameras’ view in direction of the periphery.

Fig Apple patented. 20A to 20C beneath graphically illustrates an instance of a scene digicam that features a destructive meniscus lens in entrance of the cameras within the digicam meeting.

5 Apple Tin Patent 20A BC HMD Camera System

For extra particulars, see Apple patent 11,448,886.

Few of the inventors of Apple

Dan Henigan: Optical Mechanical Engineering Supervisor

Saito Kenichi: Optical Engineer (beforehand at Canon and Fuji Picture Movie)

Brett Miller: Digicam Incubator Engineering Supervisor

Noah Bedard: Prototyping Engineer

Kathryn Berkner: Senior Engineering Supervisor – Digicam Incubator

10.52FX - Stripe Patent Granted