The Vision Pro uses 3D avatars on calls and for streaming. These researchers used eye tracking to work out the passwords and PINs people typed with their avatars.
  • subignition
    1•16 days ago

    From the article:

    Your eyes are your mouse when using the Vision Pro. When typing, you look at a virtual keyboard that hovers around, and can be moved and resized. When you’re looking at the right letter, tapping two fingers together works as a click.

    So they were working backwards to determine the inputs based off of the observed eye motion.

    I have a much less modern VR headset and you can definitely still type on a regular keyboard while you’re wearing it. You can’t see the keyboard though, so you need to be skilled enough to touch type. I can’t find any reliable-looking statistics on it with a quick search, but it seems like that is not a very common skill

    • noughtnautEnglish
      2•16 days ago

      … Like what is not a very common skill? Touch typing in general? Or doing it under VR specifically?

      • The latter would be quite niche I suppose.
      • The former? I cry for the current and future generations. It really is not very hard to learn, realistic to master, and incredibly useful in daily (professional and personal) life.
      • subignition
        1•15 days ago

        Touch typing. Like I said I cannot find any reputable statistics. touchtypeit.co.uk claims “according to research” it’s less than 20%, but does not actually link any specific research. There are some other sites like it that are trying to sell you a product and list a low percentage, but I can’t find any actual studies or statistics

    • @[email protected]English
      1•15 days ago

      Vision pro renders the keyboard into your virtual environment, like it does with your arms/hands