Sony Patents AI-Assisted Controller Inputs to Help Players With Physical Limitations
Sony has filed a patent application for an AI-assisted controller system intended to help players with physical limitations or movement-related issues play video games more easily. The application was published on September 17, 2026, according to a report by Insider Gaming, and describes an AI model that steps in when a player cannot fully press a button to trigger actuation.
Under the proposed system, the AI model analyzes how a player operates the controls, including the timing and duration of each input, movement patterns and limitations, and the game context, then generates an output that completes the intended action. The filing gives the example of a user who “may have difficulty actuating a left button, move a left joystick, press a trigger, or other controls of the controller,” with the video game system configured to generate control outputs using an AI model “pre-trained at least partially on control actuation information and accessibility data associated with the controller.”
The amount of compensation can be determined from user-specific, controller-specific or game context-specific data, and the system can also predict a player's intended action from initial inputs or the overall game history. The patent explains that the model can run either locally on the device or in the cloud. In multiplayer games, the AI can be set to deactivate automatically or be switched off manually by the player, and other players can see an indicator showing whether the AI accessibility agent is active.
The filing does not tie the system to a PlayStation controller. Instead, the AI system is described as controller-agnostic and “can still generate the control output relevant to or specific to a particular controller being used by the user,” which the report notes could make the technology more universal and potentially usable beyond Sony's own ecosystem.
The approach differs from existing adaptive options such as control remapping, because it adapts to a player's physical limitations or recurring input habits rather than requiring a fixed alternative layout. A published patent is not a shipping product, so it is not certain whether the concept will reach consumers. It nonetheless adds to a wider industry conversation about where accessibility assistance ends and automated gameplay begins.