From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-pj1-x1030.google.com (mail-pj1-x1030.google.com [IPv6:2607:f8b0:4864:20::1030]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 95B7B3CB40 for ; Fri, 17 Nov 2023 09:18:20 -0500 (EST) Received: by mail-pj1-x1030.google.com with SMTP id 98e67ed59e1d1-28398d6c9f3so654894a91.0 for ; Fri, 17 Nov 2023 06:18:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1700230699; x=1700835499; darn=lists.bufferbloat.net; h=content-transfer-encoding:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=bG/zo4B5TxzhVnwFSzjxZrX/FNGr51/vuITjWPveZLI=; b=Udhux6VwAWc5d1G4iLduh46UuOqX0S4319jEzwg2p0THC0QjqGnQnkZy4vTfZK8M01 c0NfEYjkBaef9QLgbstaRm/+0pvC2RbMy1W9twXVZFiHyyPahmIfjLM9R7dZprtn9gaV rYPMPjdOIaRbYrZ8FKaAMgR9pHO6fzBzqacDIdqcRfYnVJj+N7kj5bWuaQwKJgKzFh6J FZWOlaDdjGExQCu1Od6+G0gMqwxWMtAmz/Wg5Gid6jXFZJUkDg0qcX5k/zbf4gPciR24 kI81UZcFT1tg5sskKs/kk2NWMabcErhVSQRtylDjK5PgtVUSS8hKQyIox3Dq4lu9FXbA umlg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1700230699; x=1700835499; h=content-transfer-encoding:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=bG/zo4B5TxzhVnwFSzjxZrX/FNGr51/vuITjWPveZLI=; b=Gn03j/28r1AxPkUL4zgqoSt70Tb2o0wmbDlAaVZSc8iQKbELZbN0Mdy1e7Kw8vkg/1 4pGF+Gq1rwpKE+g5SNuYT1Bgu2kjlCdO3wwhTU46y3nR387MX9UnLN6vDkcke/y+8CyI klXP6T/Ahv/MJmWkk4VVptfIcOwRr1PGH9MXZMkiYRdBlAVrlGmeV7VXgzGipvAuFyNy 2N+B+bol1VfPwBhQ8Ks5GYIJumNpw0yrEm59VDN+ahYPQYDvB/2C8/xg4t/RXmm1nVPK Zx/5WEH4X24ZtfARwTWmKWZRfIgnY3ya/zWMUg6fQaKuKOAOunMIgHKnwauOPqBn5Ezj 1UOA== X-Gm-Message-State: AOJu0Ywtm+BQ0vvxwzUosxup6FOWDSiv994F0Z1PxG68Gf41xO1ixvMr NzuE83u10mEyaExjzv4VyzOEOuSo/LXp8dVAeSlXNUdp X-Google-Smtp-Source: AGHT+IELTT68RkxJE68qxTb6tDg7e/ALUEFFRPH3mrhzG3bmdE5Eevj26x/f/J8poVcIF8tAeLkGZE9eKB99PLeGSBk= X-Received: by 2002:a17:90a:4f:b0:280:c9a1:861e with SMTP id 15-20020a17090a004f00b00280c9a1861emr23277610pjb.13.1700230698937; Fri, 17 Nov 2023 06:18:18 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Dave Taht Date: Fri, 17 Nov 2023 09:18:05 -0500 Message-ID: To: =?UTF-8?Q?Network_Neutrality_is_back=21_Let=C2=B4s_make_the_technical_asp?= =?UTF-8?Q?ects_heard_this_time=21?= Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Subject: [NNagain] Fwd: separable processes for live in-person and live zoom-like faces X-BeenThere: nnagain@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: =?utf-8?q?Network_Neutrality_is_back!_Let=C2=B4s_make_the_technical_aspects_heard_this_time!?= List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 17 Nov 2023 14:18:20 -0000 sending again as my server acted up on this url, I think. sorry for the dup= ... ---------- Forwarded message --------- From: Sebastian Moeller Date: Fri, Nov 17, 2023 at 3:45=E2=80=AFAM Subject: Re: [NNagain] separable processes for live in-person and live zoom-like faces To: Network Neutrality is back! Let=C2=B4s make the technical aspects heard this time! Cc: , Dave T=C3=A4ht Hi Dave, dear list here is the link to the paper's web page: https://direct.mit.edu/imag/article/doi/10.1162/imag_a_00027/117875/Separab= le-processes-for-live-in-person-and-live from which it can be downloaded. This fits right in my wheel house# ;) However I am concerned that the pupil diameter differs so much between the tested conditions, which implies significant differences in actual physical stimuli, making the whole conclusion a bit shaky*)... Also placing the true face at twice the distance of the "zoom" screens while from an experimentalist perspective understandable, was a sub-optimal decision**. Not a bad study (rather the opposite), but as so often poses even more detail question than it answers. Regarding your point about latency, this seems not well controlled at all, as all digital systems will have some latency and they do not report anything substantial: "In the Virtual Face condition, each dyad watched their partner=E2=80=99s faces projected in real time on separate 24-inch 16 =C3=97 9 computer monitors placed in front of the glass" I note technically in "real-time" only means that the inherent delay is smaller than what ever delay the relevant control loop can tolerate, so depending on the problem at hand "once-per-day" can be fully real-time, while for other problems "once-per-1=C2=B5sec" might be too slow... But to give a lower bound delay number, they likely used a web cam (the paper I am afraid does not say specifically) so at best running at 60Hz (or even 30Hz) rolling shutter, so we have a) a potential image distortion from the rolling shutter (probably small due to the faces being close to at rest) and a "lens to RAM" delay of 1000/60 =3D 16.67 milliseconds. Then let's assume we can get this pushed to the screen ASAP, we will likely incur at the very least 0.5 refresh times on average for a total delay of >=3D 25ms. With modern "digital" screens that might be doing any fancy image processing (if only to calculate "over-drive" voltages to allow or faster gray-to-gray changes) the camera to eye delay might be considerably larger (adding a few frame times). This is a field where older analog systems could operate with much lower delay... I would assume that compared to the neuronal latencies of actually extracting information from the faces (it takes ~74-100ms to drive neurons in the more anterior face patches in macaques, and human brains are noticeably larger) this delay will be smallish, but it will certainly be only encountered for the "live" and not for the in-person faces. Regards Sebastian P.S.: In spite of my arguments I like the study, it is much easier to pose challenges to a study than to find robust and reliable solutions to the same challenges ;) #) Or it did, as I am not directly working on the face processing system any more *) Pupil diameter is controlled by multiple factors, ranging from its "boring" physiologic function as adaptive aperture the visual system uses to limit the amount of light hitting the retina, to some effect of cognitive processes or states of the sympathetic nervous system see e.g. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6634360/ the paper, IMHO does over play the pupil diameter reasponses by not acknoledging that these might result from things as boring as not having the true faces and zoom faces sufficiently luminosity matched. **) Correcting the size of the projected image to match in degrees of visual angle only gets you so far, as we do have some sense of distance, so the same visual angle at 70cm corresponds to a smaller head/face than the same visual angle at 140cm... this is both nit-picky, but also important. I also note that 70cm is at the edge of a typical reach distance, while 1.4 m is clearly outside, yet we do treat peri-personal space with-in effector reach differently from space beyond that. > On Nov 16, 2023, at 22:57, Dave Taht via Nnagain wrote: > > Dear Joy: > > good paper that extends the idea of zoom fatigue into something closer > to zoom-induced somnolence. Thanks for doing this kind of detailed > measurements! > > I would be very interested in a study of brain activity while varying > latency alone as the variable for videoconferencing. One being say, a > live video feed between the participants (0 latency) vs zoom (at > 500ms), or with one jittering around, or one at, say 60ms vs 500ms. I > tend to be much happier after a day using "galene.org" which tries for > minimum latency than zoom, and still find my ability to interact > quickly across a dinner table hard to get into after too many hours on > it. Are y'all pursuing further studies? > > The link to the paper is mildly puzzling in that the token is > required, and I am assuming that perhaps it is generating a > watermarked version differently on every download? > > https://watermark.silverchair.com/imag_a_00027.pdf?token=3DAQECAHi208BE49= Ooan9kkhW_Ercy7Dm3ZL_9Cf3qfKAc485ysgAAAzQwggMwBgkqhkiG9w0BBwagggMhMIIDHQIBA= DCCAxYGCSqGSIb3DQEHATAeBglghkgBZQMEAS4wEQQMBvAQsisJ_ABhWglzAgEQgIIC5womb1HI= yE-rX0v_xte9EwVGyabIjMO6g80txKAFqHmQPVEv7FostAfIK-4yXUZnSyLivNxp6pummVVwxB_= kCJEyG2DtAH2R8ywkWTTjGw22vpotfz5injZM6fMRQNyTq8dcjtMTTFpEjbsrbupEoMFo7Z0wxq= V8bmbPD8xO6hu1T8I8gg5579PZNHt7-PMNgqJVlEaxPY3nMvc1XkKYdh1RIhFetQkAdhhro2eWf= u_njMvzdRWVeN2ohY6OnSJSDljWiWxyUOqnKX6tps2XFtVBWUh2sE3HK-EsI-w0EmpBlAC7huyQ= sXkXW7tmPOwA7yiGQm4uSfcOn_EKGhvzhjHsdP8Mm1QJat6_rWSPZZGwhFzPB2Wl92DDfiSOesK= KQBv_OvmGc3FUmFAhqIeAlzlyNkdBydk2hQqvS46OTGfdBEvwpIH_AZclDiLeuyJPP5v2YaoByF= Q7w4uXHMyNhEo5mR2_pQ3WM7CpzknZixRvA5TQySW830iH0k00QZwt6a3nphgV6R4int5Pl-Qdm= CKzFoJ2EuPIBKvG9H5yBq18E6r1jyk1mdFKpo0-OEpLNIBpGm-1SomHw2qo5uCRWoAW6MO7K-sK= ZokirXGgJ7rIdRznq3BXvYxFKVn7tqJlIAAX6qDrC0bkefj8PEweuk2zIraj1Ri3otbdX3h0zBs= KgmdY6qiOn8LtyxIy3vvXLnbiaIColztgAt1cHuI6b0w3rLg7BGSE2cetBDTyGS9OS0NKq91xql= jwDAZBFkuKwtfYLzxIeeBy4KrG-PBqGtUEholGjHHyKCwxytw12qvgrTjdX7cXhYJSrs-HBJtRg= iP5Yb6DJAQrlqEKeGnyTlPv2o3jNVvT0CZ9zWX8Qm0O6wiGo1PqpxCM3VLw0VXVsWcHJ39eLYN3= 0GuHznYCaH5INdtgZoJdQbmZO3o_tF7itz1uYHItxNK_ZQ3oFKoUQd0e7sx51xaFj6VnNNo39Ms= 3mdyEQOEp > > > -- > :( My old R&D campus is up for sale: https://tinyurl.com/yurtlab > Dave T=C3=A4ht CSO, LibreQos > _______________________________________________ > Nnagain mailing list > Nnagain@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/nnagain --=20 :( My old R&D campus is up for sale: https://tinyurl.com/yurtlab Dave T=C3=A4ht CSO, LibreQos