From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from smtp1.linuxfoundation.org (smtp1.linux-foundation.org [172.17.192.35]) by mail.linuxfoundation.org (Postfix) with ESMTPS id 9FA29D3A for ; Wed, 16 May 2018 21:22:50 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.6 Received: from mout.gmx.net (mout.gmx.net [212.227.15.19]) by smtp1.linuxfoundation.org (Postfix) with ESMTPS id 7FA65683 for ; Wed, 16 May 2018 21:22:49 +0000 (UTC) Received: from [77.111.244.4] ([77.111.244.4]) by 3c-app-mailcom-bs10.server.lan (via HTTP); Wed, 16 May 2018 23:22:47 +0200 MIME-Version: 1.0 Message-ID: From: "Caius Cosades" To: bitcoin-dev@lists.linuxfoundation.org Content-Type: text/plain; charset=UTF-8 Date: Wed, 16 May 2018 23:22:47 +0200 Importance: normal Sensitivity: Normal X-Priority: 3 X-Provags-ID: V03:K1:cRmNtvd3escogoZTOUlBL2bZxSOBxvaO0E19xanGF9h w4wXYYpO3LIt833rW7px8NMV/U6jKWvBRptShhVAdQHzb8jC4P ireZhP+OWeZs/7Srcum7eJhEG1j18pbaoLPIetvuUSlHc7WSSk xzO8qISZi0d0Cm44Rhzeg+9FEbNVRJjXRmF/FFtVuuqi4VuP/s 8gkw9u2dCPfq7zmWHpx5sM7JcuV7MijUqh6expAL/vCLvbPB9j VIR99GUUy8hqa7jHHZl6Btjin1IG1OwvqCRolCREoYkaAOX+sc 7GphW8= X-UI-Out-Filterresults: notjunk:1;V01:K0:wAeBxVr6Qek=:T6/ayEfMUSvDCnFkdQeLEZ BB5XTdvtMAqcuVIQIZRp7UJqwmrVQOrv1KWz508eClysDgk9/gGsndW7QrOHO8yj3DwYJuhds zER5q4oL65lP7Fttuzc2gke4RdEjXfWFDFkVsT+RuN4+AiqnBQEhesmMVdnKnO5U78+nMNz0z 51GWf2c1J5bh8Zs1vDZAZulJEm4oa847zxngrbkVbOnfMgzZEy8YjbmdQZ9PMc+xHKtgd58Az F6Za3s7LtxxTLTrti3Y/5nJFSehl44bjz8jSx0c4drtZ5vdbCkqN+9hTVn7ytT07jlvHWDHas zwgos+3LY1w/PBps3QONyzzLKPZ9KdOoLK5QhU+cAeCYmUbTC/oFl0bU7USNNU9G1Zn42UYRB 18ILiZQq9avRaWf3U7Jw1xRwRQ3j0At4Yow/KaqhiAn3XPFc08Ml+c/22sCC8phbrwMS1gi72 5Hsv5C/cz6HFAuXMyWmzaOOwcZ05LrfHvblNJILPWDrnXAUVZFsD X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00,FREEMAIL_FROM, RCVD_IN_DNSWL_LOW autolearn=ham version=3.3.1 X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on smtp1.linux-foundation.org X-Mailman-Approved-At: Wed, 16 May 2018 21:24:02 +0000 Subject: [bitcoin-dev] Moving away from BIP37, unsetting NODE_BLOOM X-BeenThere: bitcoin-dev@lists.linuxfoundation.org X-Mailman-Version: 2.1.12 Precedence: list List-Id: Bitcoin Protocol Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 May 2018 21:22:50 -0000 As previously discussed[0][1][2] on the mailing list, github issue commentary, and IRC channels, there's substantial reason to disable BIP37 in network nodes which are getting stronger as the size of the chain increases. BIP37 has significant denial of service issues which are unsolvable in the design, it introduces undue load on the bitcoin network by default, and doesn't provide an acceptable amount of security and reliability to "lightweight wallets" as originally intended. BIP37 allows "lightweight wallets" to connect to nodes in the network, and request that they load, deseralize, and expensively apply an arbitrary bloom filter to their block files and mempool. This should never have been the role of nodes in the network, rather it should have been opt-in, or performed by a different piece of software entirely. The inability of the nodes to cache the responses or meaningfully rate limit them makes it detrimental to serve these requests. BIP37 was intended to have stronger privacy than it does in reality[3][4], where effectively any node that can capture `filterload` and `filteradd` responses can trivially de-anonymize an entire wallet that has connected irrespective of the amount of noise they add to their filters. The connected node lying by omission is undetectable by any wallet software, where they will be lead to believe that there are no matching responses; this is counter-able by further destroying privacy and loading down the network by having multiple peers simultaneously return filter results and hoping that at least one isn't lying. NODE_BLOOM has been implemented already which allows nodes to signal in their service message that they do, or do not support filtering. I suggest that in the next major release this is defaulted to 0, and any software relying on BIP37 move to using other filtering options, or another piece of dedicated software to serve the requests. Future releases of the reference software should remove BIP37 commands entirely. [0]: https://www.reddit.com/r/Bitcoin/comments/3hjak7/the_hard_work_of_core_devs_not_xt_makes_bitcoin/cu9xntf/?context=3 [1]: https://github.com/bitcoin/bitcoin/issues/6578 [2]: https://lists.linuxfoundation.org/pipermail/bitcoin-dev/2015-August/010535.html [3]: https://jonasnick.github.io/slides/2016-zurich-meetup.pdf [4]: https://eprint.iacr.org/2014/763.pdf