From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from smtp1.linuxfoundation.org (smtp1.linux-foundation.org [172.17.192.35]) by mail.linuxfoundation.org (Postfix) with ESMTPS id 2A71FA45 for ; Tue, 13 Oct 2015 22:49:46 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.6 Received: from mx1.riseup.net (mx1.riseup.net [198.252.153.129]) by smtp1.linuxfoundation.org (Postfix) with ESMTPS id 7B0CE128 for ; Tue, 13 Oct 2015 22:49:45 +0000 (UTC) Received: from cotinga.riseup.net (unknown [10.0.1.161]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "*.riseup.net", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.riseup.net (Postfix) with ESMTPS id 00638C2069; Tue, 13 Oct 2015 15:49:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=riseup.net; s=squak; t=1444776585; bh=GThGTn3Fa94ZvkNA5jtw9xRjmxKTJQqVBwm/omxMFuc=; h=Subject:To:References:From:Date:In-Reply-To:From; b=aLxNtTniB/muhsB7/4rCNkMt5Ry+Pox+2Lx9iohMZKdRha0V3dmFU6BPyRlRaFSmZ iaYOmHjfr+WRhxS4Hy2ne23tTxJu+XRLA2OuFwPbh4ANfNUmST/oF+c5ZbNM7QAPvG bvNxW5DRNCoOcoRTuXCRR6pTAatG3atRVc+8uBts= Received: from [127.0.0.1] (localhost [127.0.0.1]) (Authenticated sender: odinn.cyberguerrilla) with ESMTPSA id B281D1C0224 To: "Jonathan Toomim (Toomim Bros)" , bitcoin-xt@googlegroups.com, bitcoin-dev@lists.linuxfoundation.org References: <99C42DE7-814A-48F8-AB28-A5ADD77A9FD9@toom.im> From: odinn Message-ID: <561D8A81.2020109@riseup.net> Date: Tue, 13 Oct 2015 22:49:37 +0000 MIME-Version: 1.0 In-Reply-To: <99C42DE7-814A-48F8-AB28-A5ADD77A9FD9@toom.im> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Virus-Scanned: clamav-milter 0.98.7 at mx1.riseup.net X-Virus-Status: Clean X-Spam-Status: No, score=-2.7 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,RCVD_IN_DNSWL_LOW,T_RP_MATCHES_RCVD, UNPARSEABLE_RELAY autolearn=ham version=3.3.1 X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on smtp1.linux-foundation.org Subject: Re: [bitcoin-dev] Memory leaks? X-BeenThere: bitcoin-dev@lists.linuxfoundation.org X-Mailman-Version: 2.1.12 Precedence: list List-Id: Bitcoin Development Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Oct 2015 22:49:51 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 You should compare this to having set up a node on a completely clean computer. It would also help to know what operating system(s) you are using for both the oldie and the freshie. Also, dump your XT, is poo. Then try again, look at Core nodes on your oldie and freshie. Watch them for a bit. Cheers, O Jonathan Toomim (Toomim Bros) via bitcoin-dev: > I just noticed that several of my running bitcoind processes were > using around 3+ GB of RAM, even though the mempool itself seemed to > be under control. > > XXXX@prime:~/bin$ ./bitcoin-cli getmempoolinfo { "size" : 1896, > "bytes" : 37341328 } > > [total memory usage not shown -- I restarted bitcoind as soon as I > noticed, and didn't copy it down from top] > > 37 MB mempool, >3 GB RAM usage. Normally, when there aren't a lot > of unconfirmed txns floating around the network, memory usage is > around 600 MB, so this is quite unusual. > > After restarting the process and letting it run for a few minutes, > I get: > > PID USER PRI NI VIRT RES SHR S CPU% MEM% TIME+ > Command [###] [XXXX] 20 0 1402M 317M 49836 S 1.0 8.2 > 0:41.71 ./bitcoind -daemon > > XXXX@prime:~/bin$ ./bitcoin-cli getmempoolinfo { "size" : 1072, > "bytes" : 670000 } > > 0.67 MB mempool, 317 MB RAM usage. Much more reasonable. > > > Here's another node I'm running that has been online longer, before > restarting: > > PID USER PRI NI VIRT RES SHR S CPU% MEM% TIME+ > Command [###] [XXXX] 20 0 4961M 3540M 11080 S 2.8 45.3 > 8h20:11 bin/bitcoind -daemon > > XXXX@feather:~$ bin/bitcoin-cli getmempoolinfo { "size" : 3045, > "bytes" : 39656126 } > > 39 MB mempool, 3540 MB total memory usage. After restarting > bitcoind, I see: > > [XXXX]@feather:~$ bin/bitcoin-cli stop Bitcoin server stopping > [XXXX]@feather:~$ bin/bitcoind -daemon Bitcoin server starting > [XXXX]@feather:~$ sleep 10; bin/bitcoin-cli getmempoolinfo { "size" > : 39, "bytes" : 47037 } > > > PID USER PRI NI VIRT RES SHR S CPU% MEM% TIME+ > Command [###] [XXXX] 20 0 1640M 247M 67960 S 0.0 3.2 > 0:05.17 bin/bitcoind -daemon > > > > > Does anybody have any guesses where we might be leaking memory, or > what is using the additional 2.4 GB? I've been using > minrelaytxfee=0.00003 or similar on my nodes. Maybe there's a leak > in the minrelaytxfee code path? Has anyone else seen something > similar? > > This issue appears to happen both with Bitcoin Core 0.10.1 and with > Bitcoin XT 0.11B. > > > > _______________________________________________ bitcoin-dev mailing > list bitcoin-dev@lists.linuxfoundation.org > https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev > - -- http://abis.io ~ "a protocol concept to enable decentralization and expansion of a giving economy, and a new social good" https://keybase.io/odinn -----BEGIN PGP SIGNATURE----- iQEcBAEBCgAGBQJWHYqAAAoJEGxwq/inSG8Cp8YIAJa9xWA+rNY9ZOTWjOEZGc7Q IpXqpIyZprhEog6By/rQ7Te+xdUuaIZrMPESEoQIdMlDjRu7V2CWKGr1LbbDf2v9 A6nMhE19tazDSMAcqHlcuWRfpex3C5QD93Oo7h0QvioNLc8cseNsYzqvOW40vIFL SPJOfor6IFLEi6/0t7OBhVyaXZdhI7XD1IDxeD67IOafCDwHgixFZWS4aCpz4axj i4B8DNsVgDdeYI2STBiqnL9Sopdnc1q2CwC1ENszR+sCXwIB9vdPOtIjhtWGk1gi f+/I8IUP/jn2xIjAGixjEePCIFLFV3kI+B6akH8+TsXB4G9C3zHEHTsfCrmLblg= =VMV3 -----END PGP SIGNATURE-----