From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from smtp1.linuxfoundation.org (smtp1.linux-foundation.org [172.17.192.35]) by mail.linuxfoundation.org (Postfix) with ESMTPS id D7819514 for ; Thu, 23 Jul 2015 17:12:08 +0000 (UTC) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from mout.gmx.net (mout.gmx.net [212.227.15.18]) by smtp1.linuxfoundation.org (Postfix) with ESMTPS id 68D2F18A for ; Thu, 23 Jul 2015 17:12:07 +0000 (UTC) Received: from [46.101.177.144] by 3capp-mailcom-bs04.server.lan (via HTTP); Thu, 23 Jul 2015 19:12:04 +0200 MIME-Version: 1.0 Message-ID: From: "Slurms MacKenzie" To: leo@LeoWandersleb.de Content-Type: text/html; charset=UTF-8 Date: Thu, 23 Jul 2015 19:12:04 +0200 Importance: normal Sensitivity: Normal In-Reply-To: <55B11825.90700@LeoWandersleb.de> References: , <55B11825.90700@LeoWandersleb.de> X-UI-Message-Type: mail X-Priority: 3 X-Provags-ID: V03:K0:0+mGoNuRECIGc7Q0e77GRhVn1Nmii2E5F/ErSyyt3Ob bx0Era3yWuiTZ2wmJkN/vsKFRYl2NH4JTiY0p5WN08B8Q0x+R/ PZNwJ8axAI1w55bL21rNPkKCZeJjtfLvnD9AagqETTU4NUgr6I 3EQv1epqQYl8DJKT5i+yfQkDBQbpbST5eGoHSLE/seOPmXNjHg IcgqPeK6rTW/qjtCLaqKFSBzRm8VAbLgLP5yI43jSl7iQp96d7 sRefbbYMBAYL/bmD+28RU56ESPnsWKIh+gdky7kinY0mRIAZGe kufMNooDJ3XgkhOozNr+KVEpIrK X-UI-Out-Filterresults: notjunk:1;V01:K0:zel6Aq2aNRc=:vR3bT48qsNOg9jdyQ9yrQL 0I3jy7GuwD+ZIsC5DnDgaWrW0Va+V8yyorNjhjfaNVnGdzWLplI7jfom+s8uffubQbhWJEgXO CYPiWGHnUBtlh4w+ODJPgIF6fRyddzpvlQpsSwE0ElrC7vr2NFlafjG8Xwmj+PHudt+qjHDld xHs0h4dViKjfvsgN3sPLjx1t2ASZy0H51YueNPLNFZUe0w6MqKyknDqni6TKbZSDzl7u4OTTr ZXLZu4ALTCyso/tX06diYjQPNRcYwfJ53T6niaLmBOTqc69P5wQQc68J4nVojd6mmFglE0dME 5vhjwDOHV2mopBXiaFzwe6tEDDbqvoZLpx5U2wtT8W5ZTGHB4ixmTDNQX3HRFTBCdcx8te8oL 7uK85Vq8qLuWD/3lltmzBiGf6WvPjwZ0RrLHfmtV9wtHzvmLPBK6g/+MwTDQ5c32+JZUrgP1q H59FfnNWYg== X-Spam-Status: No, score=-1.2 required=5.0 tests=BAYES_00,FREEMAIL_FROM, HTML_MESSAGE, MIME_HTML_ONLY, RCVD_IN_DNSWL_NONE autolearn=no version=3.3.1 X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on smtp1.linux-foundation.org Cc: bitcoin-dev@lists.linuxfoundation.org Subject: Re: [bitcoin-dev] Bitcoin Node Speed Test X-BeenThere: bitcoin-dev@lists.linuxfoundation.org X-Mailman-Version: 2.1.12 Precedence: list List-Id: Bitcoin Development Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jul 2015 17:12:08 -0000
I was testing against otherwise idle nodes, fetching blocks back from the tip of the chain in an attempt to eliminate any unfair effects of caching. During the time my crawler was running there was no new blocks on the network (luck more than design), so other than initially syncing nodes and transaction broadcasts there should have been no traffic from these peers other than me.
 
There's unfortunately not enough granularity in my log to tell the difference between nodes which returned bad results (pruned nodes perhaps), and those that timed out. The total number of those was around 10 of 202 successful handshakes, which is fairly insignificant anyway. I'll retool at some point soon and run this a second time with better logging and some other tweaks I've since realised would help get more, cleaner data.
 
As Peter Todd has pointed out, my numbers are blue sky optimism and should be taken with a grain of salt as far as justifying larger blocks. I'm finding the ceiling of the node pushing a block to a single peer (which is unrealistic on the network), and leaving little headroom for anything else.
 
Sent: Thursday, July 23, 2015 at 7:36 PM
From: "Leo Wandersleb via bitcoin-dev" <bitcoin-dev@lists.linuxfoundation.org>
To: bitcoin-dev@lists.linuxfoundation.org
Subject: Re: [bitcoin-dev] Bitcoin Node Speed Test
Thank you a lot for doing this test!

Two questions:

1) A node is typically connected to many nodes that would all in parallel
download said block. In your test you measured how fast new blocks that
presumably are being uploaded in parallel to all those other nodes are being
uploaded? Or did you download blocks while those nodes were basically idle?

2) What is your percentage of the very slow connections?

On 07/23/2015 11:19 AM, slurms--- via bitcoin-dev wrote:
> On this day, the Bitcoin network was crawled and reachable nodes surveyed to find their maximum throughput in order to determine if it can safely support a faster block rate. Specifically this is an attempt to prove or disprove the common statement that 1MB blocks were only suitable slower internet connections in 2009 when Bitcoin launched, and that connection speeds have improved to the point of obviously supporting larger blocks.
>
>
> The testing methodology is as follows:
>
> * Nodes were randomly selected from a peers.dat, 5% of the reachable nodes in the network were contacted.
>
> * A random selection of blocks was downloaded from each peer.
>
> * There is some bias towards higher connection speeds, very slow connections (<30KB/s) timed out in order to run the test at a reasonable rate.
>
> * The connecting node was in Amsterdam with a 1GB NIC.
>
>
> Results:
>
> * 37% of connected nodes failed to upload blocks faster than 1MB/s.
>
> * 16% of connected nodes uploaded blocks faster than 10MB/s.
>
> * Raw data, one line per connected node, kilobytes per second http://pastebin.com/raw.php?i=6b4NuiVQ
>
>
> This does not support the theory that the network has the available bandwidth for increased block sizes, as in its current state 37% of nodes would fail to upload a 20MB block to a single peer in under 20 seconds (referencing a number quoted by Gavin). If the bar for suitability is placed at taking only 1% of the block time (6 seconds) to upload one block to one peer, then 69% of the network fails for 20MB blocks. For comparison, only 10% fail this metric for 1MB blocks.
> _______________________________________________
> bitcoin-dev mailing list
> bitcoin-dev@lists.linuxfoundation.org
> https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev




_______________________________________________
bitcoin-dev mailing list
bitcoin-dev@lists.linuxfoundation.org
https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev