An electronic device for providing a display that changes based on the user's perspective is provided. The electronic device may include a sensing mechanism operative to detect the user's position relative a display of the electronic device. For example, the electronic device may include a camera operative to detect the position of the user's head. Using the detected position, the electronic device may be operative to transform displayed objects such that the displayed perspective reflects the detected position of the user. The electronic device may use any suitable approach for modifying a displayed object, including for example a parallax transform or a perspective transform. In some embodiments, the electronic device may overlay the environment detected by the sensing mechanism (e.g., by a camera) to provide a more realistic experience for the user (e.g., display a reflection of the image detected by the camera on reflective surfaces of a displayed object).

Here's Apple's background and summary of the invention: "Using electronic devices, a user may view images of real or artificial three-dimensional objects. For example, a user surfing the Internet can view images of products available for purchase. As another example, a user of a graphic application (e.g., a CAD application) may create three-dimensional objects.

[0002]To view different perspectives of the three-dimensional objects, existing electronic devices may require the user to perform manipulations using input mechanisms, such as arrow keys or letter keys on a keyboard, mouse clicks and mouse movements, or combinations of inputs using different input mechanisms. For example, the user may provide a particular input device sequence to cause a displayed object to pan or rotate.

"While this approach for viewing three-dimensional objects may be functional, it is hardly intuitive and may even be frustrating for new users, as they discover and learn the input device sequences used for each manipulation of the object. Furthermore, objects displayed on the electronic device screen may lack realism, because the electronic device cannot know the user's environment from which the object is being viewed.

"]An electronic device operative to change the perspective of displayed three-dimensional objects based on the user's position relative to the electronic device is provided. The electronic device may include a display for displaying objects, and a sensing mechanism for detecting the user's position. The sensing mechanism may be operative to detect the user's position using any suitable sensing approach, including for example optically (e.g., using a camera or lens), from emitted invisible radiation (e.g., using an IR or UV sensitive apparatus), electromagnetic fields, or any other suitable approach. The sensing mechanism may be placed in any suitable position relative to the display. For example, the sensing mechanism may be integrated in or adjacent the display (e.g., as an integrated camera above the display). This may allow the sensing mechanism a more accurate assessment of the user's position relative to the display. For example, if the sensing mechanism is integrated with the display, the sensing mechanism may detect the user's head using a camera, and determine the position of the user's head relative to the center of the display.

"Using the detected position of the user, the electronic device may use any suitable approach to transform the perspective of three-dimensional objects displayed on the display. For example, the electronic device may use a parallax transform by which three-dimensional objects displayed on the screen may be modified to give the user the impression of viewing the object from a different perspective. This approach may be particularly effective, for example, for smaller objects or for objects displayed near the front-most plane of the display (e.g., such as a dock or menu options). As another example, the electronic device may use a perspective transform by which three-dimensional objects displayed on the screen ma be modified to give the user the impression of viewing the object from a different perspective. Using a true perspective transform may be most effective, for example, for larger objects displayed on the screen or for objects displayed farther from the plane of the display. The electronic device may determine the amount or manner in which to transform a displayed object so that the object appears to be viewed from the user's detected position.

"In some embodiments, the electronic device may perform different types of transforms on different objects when the sensing mechanism determines that the user's perspective has changed. For example, if a display has objects with which both perspective and parallax transforms are associated (e.g., based on the positions of the objects on the display, or based on metadata associated with the objects), the electronic device may apply the transforms associated with each object on different layers, and blend the modified objects to provide a display in which every three-dimensional object is modified to reflect the user's perspective from the detected position.

"To make the displayed objects more realistic to the user, the electronic device may detect the user's environment and map the detected environment to the displayed objects. For example, using a camera, the electronic device may capture images of the user and of the user's environment. The electronic device may then simultaneously modify the object displayed based on the user's perspective and map the images of the captured environment to the displayed object. For example, the electronic device may define visual properties of different surfaces of the displayed object (e.g., reflection and refraction characteristics), and apply the visual properties to the portions of the detected image mapped on each surface. Using this approach, surfaces with low reflectivity (e.g., plastic surfaces) may not reflect the environment, but may reflect light, while surfaces with high reflectivity (e.g., polished metal or chrome) may reflect both the environment (e.g., the user's face as detected by the camera) and light. To further enhance the user's experience, the detected environment may be reflected differently along curved surfaces of a displayed object (e.g., as if the user were actually moving around the displayed object and seeing his reflection based on his position and the portion of the object reflecting the image).

"In some embodiments, the electronic device may change the display of two-dimensional objects (e.g., application windows) based on the user's detected position. For example, the electronic device may assign depth values to each of several two-dimensional objects to artificially create a third dimension from which different perspectives may be determined. Then, as the user moves relative to the display, the electronic device may displace the windows (e.g., to display different portions of each window, or to distribute the windows across the display).

The inventors are Duncan R. Kerr and Nicholas V. King. The graphic below is a schematic view of an electronic device in accordance with one embodiment of the invention.

For more info on patents, check out Patents.com, a free patent search site.