From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from smtp2.osuosl.org (smtp2.osuosl.org [140.211.166.133]) by lists.linuxfoundation.org (Postfix) with ESMTP id 7D39EC0001 for ; Mon, 1 Mar 2021 11:20:12 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp2.osuosl.org (Postfix) with ESMTP id 56DAB43001 for ; Mon, 1 Mar 2021 11:20:12 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org X-Spam-Flag: NO X-Spam-Score: 0.003 X-Spam-Level: X-Spam-Status: No, score=0.003 tagged_above=-999 required=5 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001] autolearn=ham autolearn_force=no Authentication-Results: smtp2.osuosl.org (amavisd-new); dkim=pass (2048-bit key) header.d=voskuil-org.20150623.gappssmtp.com Received: from smtp2.osuosl.org ([127.0.0.1]) by localhost (smtp2.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id EkDR7BERrwcB for ; Mon, 1 Mar 2021 11:20:11 +0000 (UTC) X-Greylist: delayed 15:00:09 by SQLgrey-1.8.0 Received: from mail-pl1-f174.google.com (mail-pl1-f174.google.com [209.85.214.174]) by smtp2.osuosl.org (Postfix) with ESMTPS id 4153942FFD for ; Mon, 1 Mar 2021 11:20:11 +0000 (UTC) Received: by mail-pl1-f174.google.com with SMTP id ba1so9685584plb.1 for ; Mon, 01 Mar 2021 03:20:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=voskuil-org.20150623.gappssmtp.com; s=20150623; h=from:to:references:in-reply-to:subject:date:message-id:mime-version :content-language:thread-index; bh=vIrhOIlTDdto1fo6YJQdZf2LZ5Z5XUdn44ONsduWzlI=; b=hvN/huqbi6leKZAKWOO+AqNNq1IXKkhEdiaUvqJmQ6PjCYp5qYqwllfj/KQUCqxibV DOIal5VkkEnKyOXGC6ZcithtLsy6Nvd5DwWb7tsEJiHAt+qD+NX6qsIGR/6bku59hxUq Ag9Xqr9jAX55uQUPG85/M3Piry8Sy1667o1bgQw+oydD718KksBgw+fyJD/Q25m8lQWL p63hsdHwzsuZekdkmppqnYeGHbnSTJaddk8VlWdnrRkahV9B13qvDxxLsW3QFIGuy8hx d0uG646GSN4N3WOauDMEMER73eeoUZ5jNhdT7y9vor/MMp/HWJ8txkdtb64sK8TMsv0j bcyA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:references:in-reply-to:subject:date :message-id:mime-version:content-language:thread-index; bh=vIrhOIlTDdto1fo6YJQdZf2LZ5Z5XUdn44ONsduWzlI=; b=qKC/oJqhxI64gBbVudFWGl3XLmfS+kR1lOoXCv6qfX0ZF9PlWDjfOdL0QegUqdbnJK xGoFxtnpvQkmg4hHEcEWB5wCApFSMqBAHH622xDZsQFQtQw85JcS3gocRWDdUOOyqAfY WahIES/MDL+RCCKnRiZTjuwlJpzO1WyT2mgHQn+Xnv6VaTrhfIGLDr/2mrF6R/3DGveu 5DWIyQLb0T2QeLo5Oio2A0lN0+HbJD/MMX1ojpbxu/oWdwegi0+TztEmdF1Gf++/UJtR wfTo5LcAINM2DAA7FKNM2lGwneezGDV9j07LRjHICUI1B/zJoaaQUf+ZUAxVy5d6yuGg 9sZA== X-Gm-Message-State: AOAM531S4SWYlEADdb/+s9NurXhx9TLU9JXIn5YaGQ+/sLgFxK0ABuK6 THtxrK7ejcBY6F3iPHAupjhMvkraiO0RVdxl X-Google-Smtp-Source: ABdhPJyLivn8fEq4TEAm8QkF0tcPyroU04vRTh3izWph3J1YmgdVk7QVYjGFt2jiFNZm9/v7PzjoQg== X-Received: by 2002:a62:16c9:0:b029:1ed:df04:8fcf with SMTP id 192-20020a6216c90000b02901eddf048fcfmr14571010pfw.63.1614591426496; Mon, 01 Mar 2021 01:37:06 -0800 (PST) Received: from ERICDESKTOP ([2601:600:9c00:1d0::b000]) by smtp.gmail.com with ESMTPSA id q4sm16757202pfs.134.2021.03.01.01.37.05 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 01 Mar 2021 01:37:05 -0800 (PST) From: To: "'Bitcoin Protocol Discussion'" References: In-Reply-To: Date: Mon, 1 Mar 2021 01:37:06 -0800 Message-ID: <00b001d70e7e$7204e2f0$560ea8d0$@voskuil.org> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_NextPart_000_00B1_01D70E3B.63E350A0" X-Mailer: Microsoft Outlook 16.0 Content-Language: en-us Thread-Index: AQC3ML5SL96bh4vDDY9y8HYjlqZLVgImxkDAAI7sjCMBipy/mayMlTug Subject: Re: [bitcoin-dev] A design for Probabilistic Partial Pruning X-BeenThere: bitcoin-dev@lists.linuxfoundation.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Bitcoin Protocol Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 01 Mar 2021 11:20:12 -0000 This is a multipart message in MIME format. ------=_NextPart_000_00B1_01D70E3B.63E350A0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On Sun, Feb 28, 2021 at 10:18 AM Leo Wandersleb via bitcoin-dev = > wrote: =20 > Only headers need to be downloaded sequentially so downloading = relevant blocks from one node is totally possible with gaps in between. =20 In fact this is exactly how libbitcoin v4 works. We download and store = blocks in parallel. In the case of a restart block gaps are repopulated. = Given that headers are validated, we go after the most responsive nodes. = Based on standard deviation, we drop the slowest peers and rebalance = load to new/empty channels. We make ordered but not necessarily = sequential requests. There is no distinction between = =E2=80=9Cinitial=E2=80=9D block download, a restart, or a single or few = blocks at the top. So it=E2=80=99s referred to as continuous parallel = block download. =20 But we don=E2=80=99t prune. Personally I consider this = counterproductive. Apart from the complexity, it=E2=80=99s not healthy. = And the chain grows linearly with storage cost falling exponentially, = leading to a straightforward conclusion. =20 e ------=_NextPart_000_00B1_01D70E3B.63E350A0 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable

On Sun, Feb 28, 2021 = at 10:18 AM Leo Wandersleb via bitcoin-dev <bitcoin-dev@lists.l= inuxfoundation.org> wrote:

 

> Only = headers need to be downloaded sequentially so downloading relevant = blocks from one node is totally possible with gaps in = between.

 

In fact this is exactly how libbitcoin v4 works. We = download and store blocks in parallel. In the case of a restart block = gaps are repopulated. Given that headers are validated, we go after the = most responsive nodes. Based on standard deviation, we drop the slowest = peers and rebalance load to new/empty channels. We make ordered but not = necessarily sequential requests. There is no distinction between = =E2=80=9Cinitial=E2=80=9D block download, a restart, or a single or few = blocks at the top. So it=E2=80=99s referred to as continuous parallel = block download.

 

But we = don=E2=80=99t prune. Personally I consider this counterproductive. Apart = from the complexity, it=E2=80=99s not healthy. And the chain grows = linearly with storage cost falling exponentially, leading to a = straightforward conclusion.

 

e

------=_NextPart_000_00B1_01D70E3B.63E350A0--