1 2012-11-25 00:00:19 <TD> i'm not sure what the issue is here, a bit tired to debug. boost itself seems to have compiled OK but the Portfile for it is intense
  2 2012-11-25 00:00:20 <TD> i'm not sure what the issue is here, a bit tired to debug. boost itself seems to have compiled OK but the Portfile for it is intense
  3 2012-11-25 00:00:29 <Diablo-D3> td: its boost
  4 2012-11-25 00:00:29 <TD> it could be they're using magic switches or something to make it work
  5 2012-11-25 00:00:30 <Diablo-D3> td: its boost
  6 2012-11-25 00:00:30 <TD> it could be they're using magic switches or something to make it work
  7 2012-11-25 00:00:33 <Diablo-D3> it _does_ shit like this
  8 2012-11-25 00:00:35 <TD> heh
  9 2012-11-25 00:00:36 <TD> heh
 10 2012-11-25 00:00:46 <TD> it's at times like this i appreciate the java world a bit more
 11 2012-11-25 00:00:58 <TD> the actual error is this one
 12 2012-11-25 00:01:05 <Diablo-D3> yeah, but java has its own bullshit
 13 2012-11-25 00:01:05 <TD> opt/local/include/boost/exception/info.hpp:117: error: explicit instantiation of ???std::basic_ostream<_CharT, _Traits>& std::operator<<(std::basic_ostream<_CharT, _Traits>&, const std::basic_string<_CharT, _Traits, _Alloc>&) [with _CharT = char, _Traits = std::char_traits<char>, _Alloc = std::allocator<char>]??? but no definition available
 14 2012-11-25 00:01:06 <Diablo-D3> yeah, but java has its own bullshit
 15 2012-11-25 00:01:08 <TD> it does
 16 2012-11-25 00:01:09 <TD> it does
 17 2012-11-25 00:01:20 <TD> random toolchain explosions are rather rare though
 18 2012-11-25 00:01:26 <Diablo-D3> like, how every library I want to use usually is not in the fucking main maven repo
 19 2012-11-25 00:01:27 <Diablo-D3> like, how every library I want to use usually is not in the fucking main maven repo
 20 2012-11-25 00:02:04 <TD> 
ACTION remembers the days when he expected to actually download and install the libraries he used

 21 2012-11-25 00:02:05 <TD> 
ACTION remembers the days when he expected to actually download and install the libraries he used

 22 2012-11-25 00:02:26 <Diablo-D3> fuck that, that leads to shit like third party jars in version control
 23 2012-11-25 00:02:27 <Diablo-D3> do not want
 24 2012-11-25 00:02:28 <Diablo-D3> do not want
 25 2012-11-25 00:10:10 <sipa> TD: no blocking bugs in any case
 26 2012-11-25 00:10:11 <sipa> TD: no blocking bugs in any case
 27 2012-11-25 00:10:59 <sipa> TD: but i discovered that lingering of conflicting transactions in the mempool due to some error line appearing in debug.log post-ultraprune, for exampe
 28 2012-11-25 00:11:00 <sipa> TD: but i discovered that lingering of conflicting transactions in the mempool due to some error line appearing in debug.log post-ultraprune, for exampe
 29 2012-11-25 00:11:32 <sipa> TD: and there may be a need for a cache of recently spent transactions, to block them from entering the mempool again on retransmit
 30 2012-11-25 00:11:33 <sipa> TD: and there may be a need for a cache of recently spent transactions, to block them from entering the mempool again on retransmit
 31 2012-11-25 00:12:03 <sipa> TD: also, -checkblocks needs to be adapted (only a very reduced form of checking is implemented now)
 32 2012-11-25 00:12:04 <sipa> TD: also, -checkblocks needs to be adapted (only a very reduced form of checking is implemented now)
 33 2012-11-25 00:12:09 <TD> ok
 34 2012-11-25 00:34:09 <sipa> TD: and indeed, it seems p2pool filters the current bitcoind warning against using it for mining or business away
 35 2012-11-25 00:34:10 <sipa> TD: and indeed, it seems p2pool filters the current bitcoind warning against using it for mining or business away
 36 2012-11-25 00:34:33 <TD> deliberate?
 37 2012-11-25 00:34:41 <sipa> yes
 38 2012-11-25 00:35:19 <sipa> forrestv: i really hope there's no more potentially-forking bugs left...
 39 2012-11-25 00:35:20 <sipa> forrestv: i really hope there's no more potentially-forking bugs left...
 40 2012-11-25 00:58:06 <Luke-Jr> sipa: I'm going to need some review of my rebase of #1647 if you're available
 41 2012-11-25 00:58:07 <Luke-Jr> sipa: I'm going to need some review of my rebase of #1647 if you're available
 42 2012-11-25 00:58:14 <Luke-Jr> (not done just yet)
 43 2012-11-25 01:02:46 <D34TH> sipa: stupid question, why has noone attempted base64 coin yet?
 44 2012-11-25 01:28:40 <forrestv> sipa, with the way p2pool displays warnings, it was overly annoying. it's different than other warnings from bitcoind in that it's a result of your actions instead of network events
 45 2012-11-25 01:28:52 <forrestv> (p2pool spams them to the console every 3 seconds)
 46 2012-11-25 01:33:10 <mhiku> where can i see a documentation how to build headless bitcoind
 47 2012-11-25 01:33:38 <mhiku> makefile.unix is not working
 48 2012-11-25 01:38:23 <weex> mhiku: what unix you trying?
 49 2012-11-25 01:38:24 <weex> mhiku: what unix you trying?
 50 2012-11-25 01:44:08 <D34TH> mhiku, whats the error
 51 2012-11-25 01:46:52 <mhiku> ubuntu
 52 2012-11-25 01:47:16 <mhiku> im compiling ubuntu.. the readme is not helpful enough, its just said the dependencies
 53 2012-11-25 01:47:33 <sipa> i'm sure it doesn't say "Error: ubuntu"
 54 2012-11-25 01:48:01 <sipa> mhiku: it's probably something trivial, but you're going to need to tell us what error you get
 55 2012-11-25 01:49:05 <sipa> forrestv: well i kinda liked that... there have been serious bugs in it before, so i'm not very confortable with a lot of mining power on git head now
 56 2012-11-25 01:49:10 <sipa> D34TH: eh?
 57 2012-11-25 01:49:11 <sipa> D34TH: eh?
 58 2012-11-25 01:49:15 <sipa> Luke-Jr: not now
 59 2012-11-25 01:49:28 <D34TH> sipa: stupidity at its finest base64coin
 60 2012-11-25 01:49:29 <D34TH> :3
 61 2012-11-25 01:49:38 <sipa> i'm not sure what you mean
 62 2012-11-25 01:49:39 <sipa> i'm not sure what you mean
 63 2012-11-25 01:49:49 <D34TH> instead of sha256
 64 2012-11-25 01:49:49 <forrestv> sipa, well the warning only shows once it's already installed ... i doubt it would cause them to downgrade
 65 2012-11-25 01:49:50 <forrestv> sipa, well the warning only shows once it's already installed ... i doubt it would cause them to downgrade
 66 2012-11-25 01:50:07 <sipa> forrestv: good point
 67 2012-11-25 01:50:08 <sipa> forrestv: good point
 68 2012-11-25 01:50:18 <sipa> D34TH: base64 is not a hash function...
 69 2012-11-25 01:50:19 <sipa> D34TH: base64 is not a hash function...
 70 2012-11-25 01:50:24 <D34TH> yes
 71 2012-11-25 01:50:25 <D34TH> i know
 72 2012-11-25 01:50:26 <D34TH> i know
 73 2012-11-25 01:50:54 <sipa> so what would base64coin be?
 74 2012-11-25 01:51:20 <D34TH> no idea
 75 2012-11-25 01:51:25 <gribble> Error: "," is not a valid command.
 76 2012-11-25 01:51:25 <sipa> ,,,
 77 2012-11-25 01:51:26 <gribble> Error: "," is not a valid command.
 78 2012-11-25 01:51:36 <D34TH> just a deformation of an idea in my brain
 79 2012-11-25 01:53:40 <Luke-Jr> sipa: I think TNIAB is broken on master :<
 80 2012-11-25 01:53:58 <Luke-Jr> GBT yields error: {"code":-10,"message":"Bitcoin is downloading blocks???"}
 81 2012-11-25 01:54:05 <Luke-Jr> (neither node has any blocks)
 82 2012-11-25 01:54:06 <Luke-Jr> (neither node has any blocks)
 83 2012-11-25 01:54:07 <sipa> Luke-Jr: is it even updated to use testnet3 ?
 84 2012-11-25 01:54:21 <Luke-Jr> sipa: I use my own TNIAB script; I am referring to the theory of it :P
 85 2012-11-25 01:54:22 <Luke-Jr> sipa: I use my own TNIAB script; I am referring to the theory of it :P
 86 2012-11-25 01:54:34 <Luke-Jr> 2 nodes connected only to each other
 87 2012-11-25 01:54:38 <sipa> ok
 88 2012-11-25 01:55:21 <Luke-Jr> hmm, it didn't even try to import the old testnet3 blocks either
 89 2012-11-25 01:55:22 <Luke-Jr> hmm, it didn't even try to import the old testnet3 blocks either
 90 2012-11-25 01:55:24 <Luke-Jr> should it?
 91 2012-11-25 01:55:25 <Luke-Jr> should it?
 92 2012-11-25 01:56:10 <D34TH> TNIAB?
 93 2012-11-25 01:56:11 <D34TH> TNIAB?
 94 2012-11-25 01:56:19 <sipa> without any blocks, it's sure to think it's in IBD, no?
 95 2012-11-25 01:56:31 <sipa> that's before the (only) testnet checkpoint
 96 2012-11-25 01:56:32 <sipa> that's before the (only) testnet checkpoint
 97 2012-11-25 01:57:54 <Luke-Jr> -loadblock doesn't seem to work either :/
 98 2012-11-25 01:58:33 <sipa> what happens?
 99 2012-11-25 01:58:34 <sipa> what happens?
100 2012-11-25 01:58:50 <Luke-Jr> Importing .bitcoin/testnet3/blk0001.dat...
101 2012-11-25 01:58:51 <Luke-Jr> ERROR: ProcessBlock() : already have block 0 000000000933ea01ad0ee984209779baaec3ced90fa3f408719526f8d77f4943
102 2012-11-25 01:58:52 <Luke-Jr> ERROR: ProcessBlock() : already have block 0 000000000933ea01ad0ee984209779baaec3ced90fa3f408719526f8d77f4943
103 2012-11-25 01:59:19 <sipa> ok, and then?
104 2012-11-25 01:59:20 <sipa> ok, and then?
105 2012-11-25 01:59:36 <Luke-Jr> Flushed 0 addresses to peers.dat  79ms
106 2012-11-25 01:59:37 <Luke-Jr> Flushed 0 addresses to peers.dat  79ms
107 2012-11-25 02:00:08 <sipa> strange
108 2012-11-25 02:00:09 <sipa> strange
109 2012-11-25 02:00:50 <Luke-Jr> indeed
110 2012-11-25 02:01:46 <sipa> does importing from that file work on 0.7.1?
111 2012-11-25 02:02:43 <Luke-Jr> odd, running it in gdb seems to be working :/
112 2012-11-25 02:02:44 <Luke-Jr> odd, running it in gdb seems to be working :/
113 2012-11-25 02:03:11 <sipa> now that is even more strange
114 2012-11-25 02:03:15 <Luke-Jr> sipa: didn't try, 0.7.1 made it
115 2012-11-25 02:03:16 <Luke-Jr> sipa: didn't try, 0.7.1 made it
116 2012-11-25 02:04:31 <sipa> maybe it just worked a second time?
117 2012-11-25 02:04:32 <sipa> maybe it just worked a second time?
118 2012-11-25 02:04:42 <Luke-Jr> I tried at least 3 times before gdb
119 2012-11-25 02:04:43 <Luke-Jr> I tried at least 3 times before gdb
120 2012-11-25 02:05:01 <sipa> ok
121 2012-11-25 02:05:49 <Luke-Jr> seems to work now, sigh
122 2012-11-25 02:06:02 <Luke-Jr> well, except it still thinks it is downloading blocks
123 2012-11-25 02:06:03 <Luke-Jr> well, except it still thinks it is downloading blocks
124 2012-11-25 02:06:04 <Luke-Jr> :/
125 2012-11-25 02:06:22 <sipa> how many blocks does it have?
126 2012-11-25 02:07:37 <Luke-Jr> "blocks" : 21852,
127 2012-11-25 02:07:38 <Luke-Jr> "blocks" : 21852,
128 2012-11-25 02:07:56 <sipa> IsInitialBlockDownload seems to return true if the last block is more than 24h old
129 2012-11-25 02:07:57 <sipa> IsInitialBlockDownload seems to return true if the last block is more than 24h old
130 2012-11-25 02:08:20 <Luke-Jr> bleh
131 2012-11-25 02:08:21 <Luke-Jr> bleh
132 2012-11-25 02:08:31 <Luke-Jr> that seems like a bad rule for testnet at least
133 2012-11-25 02:08:32 <Luke-Jr> that seems like a bad rule for testnet at least
134 2012-11-25 02:08:35 <sipa> maybe we need to special-case that for testnet
135 2012-11-25 02:08:36 <sipa> maybe we need to special-case that for testnet
136 2012-11-25 02:08:41 <Luke-Jr> but even for mainnet???.
137 2012-11-25 02:08:42 <Luke-Jr> but even for mainnet???.
138 2012-11-25 02:08:49 <Luke-Jr> do we really want a deadlock condition?
139 2012-11-25 02:08:50 <Luke-Jr> do we really want a deadlock condition?
140 2012-11-25 02:08:55 <sipa> how so?
141 2012-11-25 02:09:15 <Luke-Jr> if hashpower ever drops to the point where an unlucky round is > 24 hours, we're dead
142 2012-11-25 02:09:15 <sipa> ah, no mining permitted while in IBD
143 2012-11-25 02:09:16 <sipa> ah, no mining permitted while in IBD
144 2012-11-25 02:09:23 <Luke-Jr> right
145 2012-11-25 02:09:38 <sipa> 
ACTION thinks the only solution is headers-first mode

146 2012-11-25 02:09:39 <sipa> 
ACTION thinks the only solution is headers-first mode

147 2012-11-25 02:10:46 <Luke-Jr> I think it's a bug if mining is prevented by any condition that amounts to "no blocks found recently"
148 2012-11-25 02:10:47 <Luke-Jr> I think it's a bug if mining is prevented by any condition that amounts to "no blocks found recently"
149 2012-11-25 02:11:52 <rdponticelli> <sipa> TD: no blocking bugs in any case << Wait a little, I may have catched something...
150 2012-11-25 02:12:23 <rdponticelli> A node of mine got filled with: ERROR: mempool transaction missing input
151 2012-11-25 02:12:28 <rdponticelli> And then died
152 2012-11-25 02:13:35 <sipa> rdponticelli: yes, already on it
153 2012-11-25 02:13:43 <rdponticelli> Ok
154 2012-11-25 02:14:04 <rdponticelli> Yeah, iirc knotwork reported something like that?
155 2012-11-25 02:14:05 <rdponticelli> Yeah, iirc knotwork reported something like that?
156 2012-11-25 02:14:49 <sipa> it's related to the orphans-in-mempool problem, but just saw valgrind detect an illegal memory access in that case too
157 2012-11-25 02:14:50 <sipa> it's related to the orphans-in-mempool problem, but just saw valgrind detect an illegal memory access in that case too
158 2012-11-25 02:14:58 <sipa> which means it's likely to cause crashes
159 2012-11-25 02:15:48 <rdponticelli> Yeah, mine crashed after spamming it hard
160 2012-11-25 02:15:52 <knotwork> yes it did crash eventually thats what made me look and log and see that error had been logged many many many times
161 2012-11-25 02:15:53 <knotwork> yes it did crash eventually thats what made me look and log and see that error had been logged many many many times
162 2012-11-25 02:17:00 <Luke-Jr> wow, someone actually managed to get a medical condition from bitcoin
163 2012-11-25 02:17:04 <Luke-Jr> http://belial.pt/wp/en/permanent-brain-damage-from-bitcoin-mining/
164 2012-11-25 02:17:05 <Luke-Jr> http://belial.pt/wp/en/permanent-brain-damage-from-bitcoin-mining/
165 2012-11-25 02:19:37 <sipa> isn't that like a year old?
166 2012-11-25 02:19:38 <sipa> isn't that like a year old?
167 2012-11-25 02:23:48 <Luke-Jr> sipa: maybe, but news to me! :P
168 2012-11-25 02:25:39 <Luke-Jr> sipa: reckon we should remove /P2SH/ from coinbaseaux now that we DoS non-conformant peers?
169 2012-11-25 02:25:40 <Luke-Jr> sipa: reckon we should remove /P2SH/ from coinbaseaux now that we DoS non-conformant peers?
170 2012-11-25 04:14:10 <Luke-Jr> bah, even with LevelDB, IBD is slow
171 2012-11-25 04:21:04 <D34TH> hella quick for me
172 2012-11-25 04:21:47 <jgarzik> Luke-Jr: restart with new peer
173 2012-11-25 04:21:56 <jgarzik> Luke-Jr: lather, rinse, repeat, until you get a fast one
174 2012-11-25 04:22:14 <Luke-Jr> jgarzik: restarted with old blk files copied and -reindex <.<
175 2012-11-25 04:22:23 <jgarzik> that works too ;p
176 2012-11-25 04:22:25 <Luke-Jr> btw, since when is blk0002 almost 2 GB already? :/
177 2012-11-25 04:22:26 <Luke-Jr> btw, since when is blk0002 almost 2 GB already? :/
178 2012-11-25 04:25:55 <jgarzik> woah, over $12.50!
179 2012-11-25 04:25:56 <jgarzik> woah, over $12.50!
180 2012-11-25 04:26:29 <jgarzik> 
ACTION 's entire house was hit by The Plague, and has been out of touch for several days

181 2012-11-25 04:28:43 <jgarzik> BlueMatt: 1) what is the current bloom BIP URL?
182 2012-11-25 04:29:00 <jgarzik> BlueMatt: 2) have we allocated a nServices bit for this featureset?  If not, we should.
183 2012-11-25 04:30:20 <jgarzik> any to anybody...
184 2012-11-25 04:30:21 <jgarzik> any to anybody...
185 2012-11-25 04:30:23 <jgarzik> *and
186 2012-11-25 04:30:24 <jgarzik> *and
187 2012-11-25 04:30:34 <jgarzik> Anyone willing to provide a build output for picocoin on OSX?
188 2012-11-25 04:30:46 <jgarzik> 
ACTION wants to make sure it builds there

189 2012-11-25 04:31:37 <Luke-Jr> jgarzik: https://en.bitcoin.it/wiki/BIP_0037 ?
190 2012-11-25 04:31:38 <Luke-Jr> jgarzik: https://en.bitcoin.it/wiki/BIP_0037 ?
191 2012-11-25 04:32:06 <jgarzik> Luke-Jr: tnx
192 2012-11-25 08:48:42 <Luke-Jr> [09:43:35] <Luke-Jr> BLOCK
193 2012-11-25 08:48:43 <Luke-Jr> [09:44:36] <ljrbot> Blk 0000000000000068fc5230e0d53aa8a05593ba6120cc2285aa0fd771a71a6667: Eligius-Ra 3.46963522 BTC, 1Ap6ms2Wsa6CK684B6t9CEd8yL8baCVutu 2.791404 BTC, 1PPy3wcq2CFu7znFRgeBUGtN5oWpChQvCo 1.69098832 BTC, 14E1qRCTaB8AFTrarcoQUoLqYi6KxNxaNV 1.35219112 BTC, 16kNKa7WUg8QAPFy8dJRv7USSu2fAG2pkW 1.15198468 BTC
194 2012-11-25 08:48:44 <Luke-Jr> [09:44:36] <ljrbot> Blk 0000000000000068fc5230e0d53aa8a05593ba6120cc2285aa0fd771a71a6667: Eligius-Ra 3.46963522 BTC, 1Ap6ms2Wsa6CK684B6t9CEd8yL8baCVutu 2.791404 BTC, 1PPy3wcq2CFu7znFRgeBUGtN5oWpChQvCo 1.69098832 BTC, 14E1qRCTaB8AFTrarcoQUoLqYi6KxNxaNV 1.35219112 BTC, 16kNKa7WUg8QAPFy8dJRv7USSu2fAG2pkW 1.15198468 BTC
195 2012-11-25 08:48:46 <Luke-Jr> I type faster than Bitcoin can relay!
196 2012-11-25 08:48:47 <Luke-Jr> I type faster than Bitcoin can relay!
197 2012-11-25 09:06:52 <robbak> At least you past faster.
198 2012-11-25 09:06:53 <robbak> At least you past faster.
199 2012-11-25 09:06:58 <robbak> paste*
200 2012-11-25 09:08:55 <Luke-Jr> paste what?
201 2012-11-25 09:08:56 <Luke-Jr> paste what?
202 2012-11-25 09:09:34 <Luke-Jr> even if I happened to have "BLOCK" on my clipboard, I was over a full minute earlier.
203 2012-11-25 09:09:35 <Luke-Jr> even if I happened to have "BLOCK" on my clipboard, I was over a full minute earlier.
204 2012-11-25 09:11:41 <robbak> Can we please get the 0.7.2 tree pasted back to github? I manage the FreeBSD port, and It is fixed to the github downloads. I'd rather not rework it to gitorious for this (one?) release.
205 2012-11-25 09:11:42 <robbak> Can we please get the 0.7.2 tree pasted back to github? I manage the FreeBSD port, and It is fixed to the github downloads. I'd rather not rework it to gitorious for this (one?) release.
206 2012-11-25 09:15:08 <robbak> (Ah, I now worked out what you were saying. Yes, block was slow at gettign back to you!)
207 2012-11-25 09:33:13 <sipa> Luke-Jr: IBD is slow... from network or from disk?
208 2012-11-25 09:33:31 <Luke-Jr> sipa: from disk
209 2012-11-25 09:33:32 <Luke-Jr> sipa: from disk
210 2012-11-25 09:33:37 <Luke-Jr> and network
211 2012-11-25 09:33:38 <Luke-Jr> and network
212 2012-11-25 09:33:40 <abrkn> someone please fix block explorer
213 2012-11-25 09:33:40 <Luke-Jr> slower from netwrok
214 2012-11-25 09:33:41 <abrkn> someone please fix block explorer
215 2012-11-25 09:33:42 <sipa> how long did it take you?
216 2012-11-25 09:33:43 <sipa> how long did it take you?
217 2012-11-25 09:33:46 <sipa> abrkn: poke theymos
218 2012-11-25 09:33:47 <sipa> abrkn: poke theymos
219 2012-11-25 09:34:11 <Luke-Jr> sipa: -reindex took about 5 hours
220 2012-11-25 09:34:12 <abrkn> gribble: later tell theymos that blockexplorer hasnt been working for days
221 2012-11-25 09:34:14 <Luke-Jr> network, I didn't let finish
222 2012-11-25 09:34:15 <Luke-Jr> network, I didn't let finish
223 2012-11-25 09:34:18 <abrkn> ;;later tell theymos that blockexplorer hasnt been working for days
224 2012-11-25 09:34:18 <gribble> The operation succeeded.
225 2012-11-25 09:34:19 <gribble> The operation succeeded.
226 2012-11-25 09:34:23 <sipa> Luke-Jr: slow CPU?
227 2012-11-25 09:34:24 <sipa> Luke-Jr: slow CPU?
228 2012-11-25 09:34:30 <Luke-Jr> sipa: not at all
229 2012-11-25 09:34:34 <Luke-Jr> i5-2400
230 2012-11-25 09:34:34 <sipa> Luke-Jr: or was the CPU not busy?
231 2012-11-25 09:34:43 <Luke-Jr> CPU maxed out 1 core IIRC
232 2012-11-25 09:34:44 <Luke-Jr> CPU maxed out 1 core IIRC
233 2012-11-25 09:34:49 <sipa> ok, perfect
234 2012-11-25 09:35:04 <sipa> so it's just script verification that's slow
235 2012-11-25 09:35:05 <sipa> so it's just script verification that's slow
236 2012-11-25 09:36:25 <sipa> though iirc, it was faster last time i tried it
237 2012-11-25 09:36:26 <sipa> though iirc, it was faster last time i tried it
238 2012-11-25 09:43:06 <_dr> why isn't verification multi-threaded?
239 2012-11-25 09:43:18 <sipa> because nobody implemented that yet
240 2012-11-25 09:46:33 <_dr> any particular reason like not a priority or too complex to due dependencies during verification?
241 2012-11-25 09:47:16 <Luke-Jr> indeed, deps woudl make it more complex
242 2012-11-25 09:48:17 <sipa> _dr: mostly because of how the code is structured
243 2012-11-25 09:48:18 <sipa> _dr: mostly because of how the code is structured
244 2012-11-25 09:48:35 <sipa> part of the changes i made in ultraprune are to make parallel verification easier in the future
245 2012-11-25 09:48:36 <sipa> part of the changes i made in ultraprune are to make parallel verification easier in the future
246 2012-11-25 09:48:45 <_dr> Luke-Jr: i thought so, tho i think a simple 'one-block-in-parallel' should work, right?
247 2012-11-25 09:49:18 <sipa> (i actually implemented parallel script verification, and it helped a lot, but there were some segfaults sometimes, and i wanted to solve it in a different way)
248 2012-11-25 09:49:19 <sipa> (i actually implemented parallel script verification, and it helped a lot, but there were some segfaults sometimes, and i wanted to solve it in a different way)
249 2012-11-25 09:50:10 <sipa> _dr: the way it worked was by pushing script-verification-actions on a queue, and allowing normal block processing to continue while the signatures were verified in the background by several threads
250 2012-11-25 09:52:30 <_dr> yeah, that sounds like the ovious way to go
251 2012-11-25 09:52:38 <Luke-Jr> _dr: not easily.
252 2012-11-25 09:54:05 <_dr> i wonder when openmp4 will be out, they want to support something like icc's #pragma offload for the intel mic, that way a gpu could transparently kick in for the compute-intensive stuff
253 2012-11-25 09:54:38 <sipa> the hardest part is dealing with failed verifications, because at that point, you're already busy processing successor blocks
254 2012-11-25 09:54:39 <sipa> the hardest part is dealing with failed verifications, because at that point, you're already busy processing successor blocks
255 2012-11-25 09:56:21 <Luke-Jr> sipa: probably want to cancel processing rejected blocks too
256 2012-11-25 09:57:47 <sipa> ?
257 2012-11-25 09:57:48 <sipa> ?
258 2012-11-25 09:59:51 <Luke-Jr> sipa: if a block's been shoved out of the chain, no point verifying it
259 2012-11-25 10:00:07 <sipa> Luke-Jr: oh, sure
260 2012-11-25 10:00:08 <sipa> Luke-Jr: oh, sure
261 2012-11-25 10:00:44 <sipa> the way i now plan to implement it is different: have a separate thread that finds the first block in the best chain that was not verified, and process that
262 2012-11-25 10:00:45 <sipa> the way i now plan to implement it is different: have a separate thread that finds the first block in the best chain that was not verified, and process that
263 2012-11-25 10:01:39 <sipa> i realized that you don't actually need to keep all information in memory, as the rev*.dat files contain all the consumed outputs
264 2012-11-25 10:01:40 <sipa> i realized that you don't actually need to keep all information in memory, as the rev*.dat files contain all the consumed outputs
265 2012-11-25 10:10:05 <sipa> rdponticelli, knotwork: can you try with #2033 applied?
266 2012-11-25 10:10:06 <sipa> rdponticelli, knotwork: can you try with #2033 applied?
267 2012-11-25 12:03:01 <abrkn> how does blockchain.info work? custom or rpc?
268 2012-11-25 12:03:02 <abrkn> how does blockchain.info work? custom or rpc?
269 2012-11-25 12:07:37 <Luke-Jr> custom
270 2012-11-25 12:07:38 <Luke-Jr> custom
271 2012-11-25 12:08:32 <xIsalty> rpc
272 2012-11-25 12:15:26 <sipa> definitely custom
273 2012-11-25 12:19:21 <xIsalty> neither
274 2012-11-25 12:19:22 <xIsalty> neither
275 2012-11-25 13:02:27 <abrkn> hmm, https://github.com/freewil/node-bitcoin doesnt do ssl
276 2012-11-25 13:14:56 <thermoman> exit
277 2012-11-25 13:15:01 <thermoman> oops
278 2012-11-25 15:47:22 <Diablo-D3> so when is the leveldb code being released in a stable release?
279 2012-11-25 15:47:23 <forrestv> the order of transactions in a block is completely unimportant unless they have interdependencies, and then dependencies must come first
280 2012-11-25 15:47:24 <forrestv> the order of transactions in a block is completely unimportant unless they have interdependencies, and then dependencies must come first
281 2012-11-25 15:47:25 <forrestv> is that correct?
282 2012-11-25 15:47:26 <forrestv> is that correct?
283 2012-11-25 15:51:00 <Diablo-D3> gmaxwell, sipa: are we supposed to have blk0003.dats already?
284 2012-11-25 15:56:43 <jgarzik> forrestv: a good question
285 2012-11-25 15:57:06 <jgarzik> forrestv: I always queued the ones without dependencies, and processed them in a set of progressive passes over a block
286 2012-11-25 15:57:07 <jgarzik> forrestv: I always queued the ones without dependencies, and processed them in a set of progressive passes over a block
287 2012-11-25 15:57:28 <jgarzik> would be nice if that code were not needed
288 2012-11-25 15:57:35 <jgarzik> and a single pass was guaranteed
289 2012-11-25 16:01:00 <sipa> Diablo-D3: when 0.8 is ready, and there is some work left
290 2012-11-25 16:01:01 <sipa> Diablo-D3: when 0.8 is ready, and there is some work left
291 2012-11-25 16:01:32 <sipa> forrestv: order indeed doesn't matter apart from dependenciew, and that the coinbase must be first
292 2012-11-25 16:01:33 <sipa> forrestv: order indeed doesn't matter apart from dependenciew, and that the coinbase must be first
293 2012-11-25 16:39:43 <maaku> D34TH: what's a base64 coin?
294 2012-11-25 16:39:44 <maaku> D34TH: what's a base64 coin?
295 2012-11-25 17:19:08 <BlueMatt> jgarzik: it has not yet been updated for sipa's partial merkle branch stuff
296 2012-11-25 17:19:35 <BlueMatt> jgarzik: the way its implemented now, a protocol version bump indicates support for filters, not a nServices bit
297 2012-11-25 17:20:33 <BlueMatt> (the argument being that bloom filters are relatively easy to implement and cost no additional load aside form serving blocks in general, so there will not be nodes which serve blocks but not filters
298 2012-11-25 17:20:34 <BlueMatt> (the argument being that bloom filters are relatively easy to implement and cost no additional load aside form serving blocks in general, so there will not be nodes which serve blocks but not filters
299 2012-11-25 17:22:40 <pjorrit_> maaku: it's like rot13 coin but less obvious
300 2012-11-25 17:23:43 <maaku> ah ok. i thought he was talking about base64 addresses or something like that
301 2012-11-25 17:23:44 <maaku> ah ok. i thought he was talking about base64 addresses or something like that
302 2012-11-25 17:30:31 <D34TH> back
303 2012-11-25 17:30:41 <D34TH> maaku, deformation of an idea in my head
304 2012-11-25 17:45:52 <Amit_btc> Is it safe to assume that output = (Public key hash, index, amount)?
305 2012-11-25 17:46:18 <Amit_btc> and that input = (prev tx output, public key, signature)
306 2012-11-25 18:02:54 <sipa> Amit_btc: true for standard pay-to-pubkeyhash transactions
307 2012-11-25 18:03:25 <sipa> Amit_btc: but e.g. not for pay-to-pubkey or pay-to-scripthash or multisig transactions
308 2012-11-25 18:04:29 <Amit_btc> pay to pub key seems to be a variant of pay to pubkey hash
309 2012-11-25 18:05:50 <Amit_btc> how exactly does pay-to-script-hash work? does it also require a signature at some point?
310 2012-11-25 18:08:27 <Luke-Jr> https://en.bitcoin.it/wiki/BIP_0016
311 2012-11-25 18:08:28 <Luke-Jr> https://en.bitcoin.it/wiki/BIP_0016
312 2012-11-25 19:01:37 <Luke-Jr> BlueMatt: any chance of getting a rebased bloom? :/
313 2012-11-25 19:17:09 <sipa> BlueMatt: i probably broke bloom because of the CBlockHeader split
314 2012-11-25 19:17:10 <sipa> BlueMatt: i probably broke bloom because of the CBlockHeader split
315 2012-11-25 19:17:15 <sipa> should be trivial to fix
316 2012-11-25 19:17:16 <sipa> should be trivial to fix
317 2012-11-25 19:21:51 <Luke-Jr> sipa: I hope my trivial fix works XD
318 2012-11-25 19:22:08 <Luke-Jr> instead of SERHEADERONLY or whatever it was, I serialized .GetBlockHeader()
319 2012-11-25 19:22:09 <Luke-Jr> instead of SERHEADERONLY or whatever it was, I serialized .GetBlockHeader()
320 2012-11-25 20:07:04 <Diablo-D3> hrm
321 2012-11-25 20:07:12 <Diablo-D3> I do believe my client has gone insane
322 2012-11-25 20:07:18 <Diablo-D3> -rw-r--r--   1 diablo diablo 2097199095 Jul 10 04:14 blk0001.dat
323 2012-11-25 20:07:19 <Diablo-D3> -rw-r--r--   1 diablo diablo 2097199095 Jul 10 04:14 blk0001.dat
324 2012-11-25 20:12:55 <sipa> Luke-Jr: exactly
325 2012-11-25 20:13:03 <Diablo-D3> what did he say?
326 2012-11-25 20:13:37 <sipa> Diablo-D3: did you at some point delete blkindex.dat without deleting the rest, or used -loadblock on your own datafiles?
327 2012-11-25 20:13:38 <sipa> Diablo-D3: did you at some point delete blkindex.dat without deleting the rest, or used -loadblock on your own datafiles?
328 2012-11-25 20:13:47 <Diablo-D3> sipa: no but
329 2012-11-25 20:13:56 <Diablo-D3> the power plug got lose on my hd
330 2012-11-25 20:14:06 <Diablo-D3> and I had to fsck manually on boot
331 2012-11-25 20:14:19 <Diablo-D3> so I think Im going to do a wallet.dat save and start again
332 2012-11-25 20:14:56 <sipa> meh, i hope that such problems are gone when we ditch bdb
333 2012-11-25 20:15:08 <Luke-Jr> sipa: I think LevelDB is less rsync-backup-friendly than bdb was :/
334 2012-11-25 20:15:12 <Diablo-D3> Im going to cheat though
335 2012-11-25 20:15:22 <Diablo-D3> put .bitcoin in /run/shm
336 2012-11-25 20:15:23 <sipa> Luke-Jr: much more so
337 2012-11-25 20:15:24 <sipa> Luke-Jr: much more so
338 2012-11-25 20:15:30 <sipa> Luke-Jr: it has immutable files
339 2012-11-25 20:15:38 <Luke-Jr> sipa: but they get replaced so often
340 2012-11-25 20:15:39 <Luke-Jr> sipa: but they get replaced so often
341 2012-11-25 20:15:44 <sipa> yes
342 2012-11-25 20:15:45 <Luke-Jr> the .sst ones
343 2012-11-25 20:15:45 <sipa> yes
344 2012-11-25 20:16:04 <sipa> how is that unfriendly?
345 2012-11-25 20:16:05 <sipa> how is that unfriendly?
346 2012-11-25 20:16:06 <Diablo-D3> 209566 blocks remaining
347 2012-11-25 20:16:09 <Diablo-D3> ;;bc,blocks
348 2012-11-25 20:16:10 <gribble> 209566
349 2012-11-25 20:16:12 <Diablo-D3> :D
350 2012-11-25 20:16:13 <Diablo-D3> :D
351 2012-11-25 20:16:13 <Luke-Jr> sipa: rsync has to delete and copy
352 2012-11-25 20:16:15 <Luke-Jr> sipa: rsync has to delete and copy
353 2012-11-25 20:16:41 <sipa> but the files that didn't change won't need any update at all
354 2012-11-25 20:16:42 <sipa> but the files that didn't change won't need any update at all
355 2012-11-25 20:17:04 <Luke-Jr> maybe, but bdb's files never took as long as these .sst ones do :P
356 2012-11-25 20:17:05 <Luke-Jr> maybe, but bdb's files never took as long as these .sst ones do :P
357 2012-11-25 20:17:27 <Diablo-D3> hrm wonder how long its going to take to start block download
358 2012-11-25 20:17:28 <Diablo-D3> hrm wonder how long its going to take to start block download
359 2012-11-25 20:18:07 <sipa> Luke-Jr: meh, minor inconvenience compared to all advantages
360 2012-11-25 20:18:08 <sipa> Luke-Jr: meh, minor inconvenience compared to all advantages
361 2012-11-25 20:18:10 <Diablo-D3> wait there it goes
362 2012-11-25 20:18:32 <Diablo-D3> 200k to go
363 2012-11-25 20:19:07 <Luke-Jr> sipa: fair enough. I suppose I shouldn't be backing up this leveldb stuff anyhow
364 2012-11-25 20:19:09 <Diablo-D3> 190k to go
365 2012-11-25 20:19:42 <Diablo-D3> 180k to go
366 2012-11-25 20:20:29 <Diablo-D3> 170k to go
367 2012-11-25 20:21:15 <sipa> Luke-Jr: btw, the main purpose of my block dl proposal is not preventing duplicate downloads, it is making it resilient against connectiin failures and other stuff that messes up the ibd process
368 2012-11-25 20:21:16 <sipa> Luke-Jr: btw, the main purpose of my block dl proposal is not preventing duplicate downloads, it is making it resilient against connectiin failures and other stuff that messes up the ibd process
369 2012-11-25 20:21:48 <sipa> Diablo-D3: slow
370 2012-11-25 20:22:07 <Diablo-D3> very, its stuck in the 160ks
371 2012-11-25 20:22:27 <Diablo-D3> GET ON WITH IT
372 2012-11-25 20:22:35 <sipa> i usually get around 130k blocks in two minutes when importing from disk
373 2012-11-25 20:22:36 <sipa> i usually get around 130k blocks in two minutes when importing from disk
374 2012-11-25 20:22:43 <Diablo-D3> sipa: 3mbps internet
375 2012-11-25 20:22:53 <sipa> well, ibd is broken anyhow
376 2012-11-25 20:22:57 <sipa> from network
377 2012-11-25 20:23:23 <sipa> well, not broken, but the hack that used to work becomes more and more apparent
378 2012-11-25 20:24:15 <Diablo-D3> 160k
379 2012-11-25 20:25:12 <Luke-Jr> sigh, spam has killed voip
380 2012-11-25 20:25:33 <sipa> ?
381 2012-11-25 20:25:34 <sipa> ?
382 2012-11-25 20:26:32 <Luke-Jr> sipa: every other day, some spammer floods my phones with 100 concurrent dead calls for 5-15 minutes straight
383 2012-11-25 20:26:33 <Diablo-D3> 150k
384 2012-11-25 20:26:33 <Luke-Jr> sipa: every other day, some spammer floods my phones with 100 concurrent dead calls for 5-15 minutes straight
385 2012-11-25 20:26:34 <Diablo-D3> 150k
386 2012-11-25 20:27:43 <Luke-Jr> sipa: what's the current status of master interoperability with older clients?
387 2012-11-25 20:28:26 <Diablo-D3> 140k
388 2012-11-25 20:28:54 <Diablo-D3> /run/shm is now 101mb
389 2012-11-25 20:29:30 <sipa> Luke-Jr: define interoperability
390 2012-11-25 20:29:31 <sipa> Luke-Jr: define interoperability
391 2012-11-25 20:29:46 <Luke-Jr> sipa: switching between using 0.7 and master on the same datadir
392 2012-11-25 20:29:47 <Luke-Jr> sipa: switching between using 0.7 and master on the same datadir
393 2012-11-25 20:30:01 <sipa> Luke-Jr: works, they just don't use the same data files
394 2012-11-25 20:30:02 <sipa> Luke-Jr: works, they just don't use the same data files
395 2012-11-25 20:30:10 <Luke-Jr> sipa: except for wallet?
396 2012-11-25 20:30:11 <sipa> Luke-Jr: except for peers.dat and wallet.dat
397 2012-11-25 20:30:12 <sipa> Luke-Jr: except for peers.dat and wallet.dat
398 2012-11-25 20:30:13 <sipa> Luke-Jr: except for peers.dat and wallet.dat
399 2012-11-25 20:30:30 <Diablo-D3> 130k
400 2012-11-25 20:30:55 <Luke-Jr> sipa: reckon it'd be wise for me to hack in next-test a: if(blk00000.dat doesn't exist) copy old blk??????.dat files and enable -reindex automatically ?
401 2012-11-25 20:31:02 <Diablo-D3> now 144m
402 2012-11-25 20:31:03 <Diablo-D3> now 144m
403 2012-11-25 20:31:20 <sipa> Luke-Jr: if you do, make it a pullreq
404 2012-11-25 20:31:22 <sipa> Luke-Jr: if you do, make it a pullreq
405 2012-11-25 20:31:29 <Luke-Jr> sipa: even for a hack? :/
406 2012-11-25 20:31:30 <Luke-Jr> sipa: even for a hack? :/
407 2012-11-25 20:31:35 <sipa> oh, you want to copy, not move
408 2012-11-25 20:31:36 <sipa> oh, you want to copy, not move
409 2012-11-25 20:31:57 <sipa> makes sense
410 2012-11-25 20:33:20 <Diablo-D3> 120k
411 2012-11-25 20:33:26 <Diablo-D3> 117m... wat
412 2012-11-25 20:33:27 <Diablo-D3> 117m... wat
413 2012-11-25 20:33:56 <Diablo-D3> I wonder if its compacting the db automatically
414 2012-11-25 20:33:57 <Diablo-D3> I wonder if its compacting the db automatically
415 2012-11-25 20:34:00 <sipa> yes
416 2012-11-25 20:34:01 <sipa> yes
417 2012-11-25 20:34:12 <sipa> every time the write log gets full
418 2012-11-25 20:34:13 <sipa> every time the write log gets full
419 2012-11-25 20:34:27 <sipa> by default it is capped to 100 MB
420 2012-11-25 20:34:28 <sipa> by default it is capped to 100 MB
421 2012-11-25 20:35:29 <Diablo-D3> 110k left
422 2012-11-25 20:35:30 <Diablo-D3> 110k left
423 2012-11-25 20:35:34 <Diablo-D3> 181m
424 2012-11-25 20:35:41 <Diablo-D3> first 100k are done
425 2012-11-25 20:35:42 <Diablo-D3> first 100k are done
426 2012-11-25 20:35:59 <sipa> yeah i know how painfully slow it is
427 2012-11-25 20:36:12 <Diablo-D3> yeah but its funny how little Ive downloaded
428 2012-11-25 20:36:24 <Diablo-D3> first 100k only used like 150mb on disk
429 2012-11-25 20:36:34 <sipa> i almost forgot, until i tried a full sync on 0.7.1 via -connect=127.0.0.1
430 2012-11-25 20:36:35 <sipa> i almost forgot, until i tried a full sync on 0.7.1 via -connect=127.0.0.1
431 2012-11-25 20:37:46 <sipa> Diablo-D3: feel free to try git head though, it should be significantly faster
432 2012-11-25 20:38:02 <Diablo-D3> 100k left, 205m
433 2012-11-25 20:38:03 <Diablo-D3> 100k left, 205m
434 2012-11-25 20:38:11 <Diablo-D3> sipa: well, Ive never done this in a ramdisk before
435 2012-11-25 20:38:16 <Diablo-D3> it usually takes MUUUUUUUUUUUCH longer
436 2012-11-25 20:38:17 <Diablo-D3> it usually takes MUUUUUUUUUUUCH longer
437 2012-11-25 20:39:47 <sipa> even so early?
438 2012-11-25 20:39:48 <sipa> even so early?
439 2012-11-25 20:40:01 <Diablo-D3> yes
440 2012-11-25 20:40:07 <Diablo-D3> last time I rebuilt db was like 100k blocks ago
441 2012-11-25 20:40:11 <Diablo-D3> and it'd still take like a day
442 2012-11-25 20:40:12 <Diablo-D3> and it'd still take like a day
443 2012-11-25 20:40:32 <sipa> well, at least from disk, i import 140k blocks in 3 minutes on git head
444 2012-11-25 20:40:52 <sipa> from network it's obviously slower
445 2012-11-25 20:40:53 <sipa> from network it's obviously slower
446 2012-11-25 20:43:57 <Diablo-D3> 90k left, 259m
447 2012-11-25 20:44:39 <sipa> what isbthat blk000*.dat, blkindex.dat, database/, ..., all together?
448 2012-11-25 20:44:49 <Diablo-D3> yeah
449 2012-11-25 20:44:56 <Diablo-D3> and peers.dat and wallet.dat which are like 10 megs
450 2012-11-25 20:45:01 <sipa> ok
451 2012-11-25 20:45:18 <Diablo-D3> oh and debug.log
452 2012-11-25 20:45:20 <Diablo-D3> so thats like 20 megs