[Cerowrt-devel] Fwd: You're Invited: DWeb Virtual Meetup—next Wednesday--Decentralized Storage 💾 💻

[Cerowrt-devel] Fwd: You're Invited: DWeb Virtual Meetup—next Wednesday--Decentralized Storage 💾 💻

[Dave Taht]

[-- Attachment #1: Type: text/plain, Size: 4923 bytes --]

while I'm referring to stuff that's actually fun and off-topic... I've long
off been watching progress in this area, knowing that
"fixing bufferbloat" is a key requirement for technologies like this to
succeed.

I have to note that I am finding jitsi meet, rather than zoom, quite
useful. The frame rate, in particular, is amazing.


---------- Forwarded message ---------
From: Wendy Hanamura <Wendy@archive.org>
Date: Fri, May 8, 2020 at 4:24 PM
Subject: You're Invited: DWeb Virtual Meetup—next Wednesday--Decentralized
Storage 💾 💻
To: <dave.taht@gmail.com>


Wed. May 13: Meet the leaders of Filecoin & Storj; network with
Decentralized Web Community
Join us: Virtual DWeb Meetup Decentralized Storage
Dear Friends,
Every cloud has its silver lining! While we can't camp, congregate or meet
in person right now, we can still come together and meet new people
interested in the Decentralized Web. And untethered from one location, we
can connect across timezones and continents.

Join us for the very first virtual *DWeb Meetup:  Decentralized Storage
Comes of Age. Wednesday, May 13 at 10 AM Pacific. *
Register Now
<https://decentalizedweb.us20.list-manage.com/track/click?u=4b9b07f44a3c9768397a9cb9f&id=5957402127&e=1837415047>
*Michelle Lee, Protocol Labs, Shawn Wilkinson, Storj Co-founder & Ben
Golub, CEO of Storj will take you through the lessons they've learned.*
We'll hear from leaders of Storj Labs
<https://decentalizedweb.us20.list-manage.com/track/click?u=4b9b07f44a3c9768397a9cb9f&id=9329ffc957&e=1837415047>
and Protocol Lab's Filecoin
<https://decentalizedweb.us20.list-manage.com/track/click?u=4b9b07f44a3c9768397a9cb9f&id=59311248ba&e=1837415047>
as they offer enterprise-level decentralized storage, collectively
preserving the data we need to fuel scientific collaboration, education,
and AI research.

Storj Labs recently released its V3 Network
<https://decentalizedweb.us20.list-manage.com/track/click?u=4b9b07f44a3c9768397a9cb9f&id=f5f969eb85&e=1837415047>
with
enterprise service level partners.

This week, Filecoin launched the Filecoin Discover
<https://decentalizedweb.us20.list-manage.com/track/click?u=4b9b07f44a3c9768397a9cb9f&id=2c33f3d23a&e=1837415047>
program
to incentivize early miners to store open source data (including some from
the Internet Archive).

What are the governance issues? How do you handle take down in a
decentralized network? How can developers build on top of these storage
networks? How can you become a storage node? What type of collaborations
are happening? We'll break into small groups to discuss these subjects and
more.

When you register, we'll send you a Zoom Link, Password, and two 10-minute
presentations by the Co-founder and CEO of Storj, and the Storage &
Developer Tools Lead of Filecoin. Watch the talks beforehand.  Then spend
90 minutes of MeetUp time networking, meeting new people, and exploring
subjects in small groups.
Seats are limited, claim yours now
<https://decentalizedweb.us20.list-manage.com/track/click?u=4b9b07f44a3c9768397a9cb9f&id=f07b097961&e=1837415047>
What About DWeb Camp 2020?

Where will we all be in September 2020? How can the DWeb Community be most
useful in this COVID crisis? Those are the questions we are asking
ourselves. One answer: by sharing our knowledge in building
community-driven infrastructure. We are proud to announce a new
website *Meshnet
@DWeb Camp 2019
<https://decentalizedweb.us20.list-manage.com/track/click?u=4b9b07f44a3c9768397a9cb9f&id=f66df0913a&e=1837415047>,*
replete with everything you'd need to build a mesh network for your
community.
Read More Here
<https://decentalizedweb.us20.list-manage.com/track/click?u=4b9b07f44a3c9768397a9cb9f&id=bfdf7e4329&e=1837415047>
[image: Facebook]
<https://decentalizedweb.us20.list-manage.com/track/click?u=4b9b07f44a3c9768397a9cb9f&id=49b9bc9a41&e=1837415047>
[image: Twitter]
<https://decentalizedweb.us20.list-manage.com/track/click?u=4b9b07f44a3c9768397a9cb9f&id=009968bcdf&e=1837415047>
[image: Link]
<https://decentalizedweb.us20.list-manage.com/track/click?u=4b9b07f44a3c9768397a9cb9f&id=548c39ff5e&e=1837415047>
[image: Website]
<https://decentalizedweb.us20.list-manage.com/track/click?u=4b9b07f44a3c9768397a9cb9f&id=7a63e3dc1f&e=1837415047>
*Copyright © 2020 Internet Archive, All rights reserved.*

*Our mailing address is:*
300 Funston Avenue, San Francisco, CA 94118

Want to change how you receive these emails?
You can update your preferences
<https://decentalizedweb.us20.list-manage.com/profile?u=4b9b07f44a3c9768397a9cb9f&id=7c6b1e3624&e=1837415047>
or unsubscribe from this list
<https://decentalizedweb.us20.list-manage.com/unsubscribe?u=4b9b07f44a3c9768397a9cb9f&id=7c6b1e3624&e=1837415047&c=d498099fb3>
.




-- 
Make Music, Not War

Dave Täht
CTO, TekLibre, LLC
http://www.teklibre.com
Tel: 1-831-435-0729

[-- Attachment #2: Type: text/html, Size: 38306 bytes --]

Re: [Cerowrt-devel] Fwd: You're Invited: DWeb Virtual Meetup 14next Wednesday--Decentralized Storage �3D�BE �3D�BB

[Valdis Klētnieks]

[-- Attachment #1: Type: text/plain, Size: 1534 bytes --]

On Fri, 08 May 2020 16:40:20 -0700, Dave Taht said:

> while I'm referring to stuff that's actually fun and off-topic... I've long
> off been watching progress in this area, knowing that
> "fixing bufferbloat" is a key requirement for technologies like this to
> succeed.

Amen to that.  Probably around a decade ago, $DAYJOB at the time was approached
by a vendor who had a very compelling and cost-effective erasure-coded storage
product that would have allowed us to have the data at 3 sites, and total loss
of any one would be survivable.  Two sites were about 3 cable miles apart, and
the third was 95 cable miles and could only run at 10Gig speed back then.

And what sank the deal was uncertainty if we could meet throughput requirements
under heavy load with one site that distant.  (You'd be *amazed* what happens
in the first 3 minutes after semester add/drop goes live at midnight, when you
have 35,000 students. :)

The other great bugaboo - How do you back up a half billion files that total
12+ petabytes? (It doesn't help the solution space when the majority of it is
one research group that (a) will probably eventually data-mine their data for
$100M+ in research grants and also (b) the terms of some of the grants
specified a 30 year retention  on the data *and* some wicked nasty PII issues,
because the data includes identifiable video of people who had not consented to
be part of the research study...

Storage - it turns out you can't just throw 10 terabyte drives at the problem. :)

[-- Attachment #2: Type: application/pgp-signature, Size: 832 bytes --]

Re: [Cerowrt-devel] Fwd: You're Invited: DWeb Virtual Meetup 14next Wednesday--Decentralized Storage Ø3DÜBE Ø3DÜBB

[Dave Taht]

On Sat, May 9, 2020 at 12:34 AM Valdis Klētnieks
<valdis.kletnieks@vt.edu> wrote:
>
> On Fri, 08 May 2020 16:40:20 -0700, Dave Taht said:
>
> > while I'm referring to stuff that's actually fun and off-topic... I've long
> > off been watching progress in this area, knowing that
> > "fixing bufferbloat" is a key requirement for technologies like this to
> > succeed.
>
> Amen to that.  Probably around a decade ago, $DAYJOB at the time was approached
> by a vendor who had a very compelling and cost-effective erasure-coded storage
> product that would have allowed us to have the data at 3 sites, and total loss
> of any one would be survivable.  Two sites were about 3 cable miles apart, and
> the third was 95 cable miles and could only run at 10Gig speed back then.
>
> And what sank the deal was uncertainty if we could meet throughput requirements
> under heavy load with one site that distant.  (You'd be *amazed* what happens
> in the first 3 minutes after semester add/drop goes live at midnight, when you
> have 35,000 students. :)
>
> The other great bugaboo - How do you back up a half billion files that total
> 12+ petabytes? (It doesn't help the solution space when the majority of it is
> one research group that (a) will probably eventually data-mine their data for
> $100M+ in research grants and also (b) the terms of some of the grants
> specified a 30 year retention  on the data *and* some wicked nasty PII issues,
> because the data includes identifiable video of people who had not consented to
> be part of the research study...

Well, someone(s) are probably doing that with government money anyway.

> Storage - it turns out you can't just throw 10 terabyte drives at the problem. :)

I still rather like bittorrrent. I've come to understand, over the
years, why it got structured the way it did.
The typical behavior of having 5 open streams and switching between
them every 15 seconds or so
is a direct outgrowth of bufferbloat, compensating for slow start in
an overbuffered universe,  and
maxing out at 100ms observed induced delay, even with the latecomer
problem, works as best
as it can.

the further, more recent adopion of vpns for it add intrinsic delay,
and that also makes the impact
of the protocol on edge networks less.

It's not quite a dead protocol, and the implementations could still be
better of course,

But in no case can I come up with some way to keep file integrity for
10PB with even thousands of
volunteer users providing chunks of storage. Hard problem! That said,
thousands of nodes providing
resiliency for the semester end/drop - far worse than mothers day -
problem - does makes sense.

the whole covid-19 thing - trying to match available hospital
resources against the potential growth
in infection rate - is bufferbloat in the real world - covidbloat -
and I wish more folk understood
that the queue theory problems are the same.

-- 
Make Music, Not War

Dave Täht
CTO, TekLibre, LLC
http://www.teklibre.com
Tel: 1-831-435-0729