Apple is researching the development of an Apple Pencil-like handheld controller that can be used with various devices, including the Apple Vision Pro. Despite not requiring a handheld controller, Apple is considering creating a virtual brush tip for this device. The patent application describes the controller as having an elongated marker-shaped housing, which can be held like a pen, pencil, marker, wand, or tool. It is intended to be a versatile controller for head-mounted devices, cellular phones, tablets, laptops, and more.
For head-mounted devices like the Apple Vision Pro, the controller may have a virtual tip that interacts with virtual content displayed on the device’s screen. The patent also mentions the use of an inertial measurement unit and wireless communication for tracking motions and interactions. While the patent’s language is broad, it primarily focuses on a chunky Apple Pencil-like device with a physical tip. The patent application lists five inventors, including Yuhao Pan, who has previously worked on voice authentication using ultrasonic sensors.
