1 2017-09-01 00:20:56	0|sipa|achow101: i overlooked it before; i've locked the comments on the first commit
 2 2017-09-01 00:21:12	0|achow101|yay
 3 2017-09-01 00:21:29	0|achow101|less spam
 4 2017-09-01 00:22:12	0|gmaxwell|oh thats why achow was asking. :P
 5 2017-09-01 00:27:00	0|jtimon|review beg https://github.com/bitcoin/bitcoin/pull/8994 now there's no exception for testing segwit.py and I left the loading of the parameters from aseparated file for later
 6 2017-09-01 00:33:46	0|achow101|I think I am close to figuring out what happened with #11171, and it is not related to the off screen thing
 7 2017-09-01 00:46:28	0|achow101|well while trying to debug that thing, I found a different bug :/
 8 2017-09-01 01:05:06	0|sipa|achow101: you're on a roll
 9 2017-09-01 01:06:38	0|achow101|sipa: can you help? This is as far as I got: https://github.com/bitcoin/bitcoin/issues/11171#issuecomment-326457725
10 2017-09-01 01:06:57	0|achow101|I'm not sure if I've gone down the wrong rabbit hole or if I am just not seeing something
11 2017-09-01 01:11:49	0|sipa|achow101: calling a virtual method on a null pointer will cause a segfault, but this is not true for normal methods (though it's undefined behaviour, in practice the method just gets called with a this == nullptr)
12 2017-09-01 01:12:12	0|sipa|of course, if the called method tries to access any class fields, a segfault will occur
13 2017-09-01 01:14:15	0|achow101|is there a virtual method here?
14 2017-09-01 01:14:38	0|sipa|i don't know - i know almost nothing about the GUI code
15 2017-09-01 04:07:28	0|kallewoof|Ugh... I didn't realize the mempool propagated quite as slowly as it does. I have 3 public nodes (one has been up for months, one for a week or two, and one was started up yesterday). The mempools on each is quite different. 4827 entries for the longest running one, 2848 for the second and 802 for the third.
16 2017-09-01 04:08:25	0|sipa|that's not necessarily due to propagation
17 2017-09-01 04:08:39	0|kallewoof|What else could be causing it?
18 2017-09-01 04:09:03	0|sipa|if the differences are in transactions that (directly or indirectly) depend on unconfirmed transactions that were in the older running nodes but not in the newer ones, that's expected
19 2017-09-01 04:09:13	0|sipa|there is no mempool reconciliation
20 2017-09-01 04:09:52	0|kallewoof|So most of the extra cruft would be for low fee txs that are not making it into blocks for a long time?
21 2017-09-01 04:10:06	0|kallewoof|Oh wait, I see what you're saying
22 2017-09-01 04:11:15	0|kallewoof|Node gets a tx with an input that is unconfirmed and unknown and the node discards it. Or wait, it puts it in orphanTx vector, right? Maybe I can use that to get a better picture..
23 2017-09-01 04:17:02	0|kallewoof|sipa: Weird. It looks like a node will ask for parent txs if it runs into a tx with unknown inputs, presuming it hasn't rejected any of its parents before. Doesn't that address what you said?
24 2017-09-01 04:18:20	0|kallewoof|for loop over vin that does `if (!AlreadyHave(_inv)) pfrom->AskFor(_inv);` (net_processing.cpp somewhere around line 1900 or so)
25 2017-09-01 04:21:36	0|sipa|kallewoof: perhaps they already have a conflict for the parent?
26 2017-09-01 04:22:57	0|kallewoof|I could see that be the case for a couple of transactions (having a double spent parent I guess? where one node sees one and the other sees the other), but the old node has 4x the # of txs compared to the 1 day old one. seems high.
27 2017-09-01 04:24:07	0|kallewoof|Connection counts are 63, 17, 14 which might mean that some txs simply don't get very far (need lots of peers to see them), but maybe there's another reason.
28 2017-09-01 04:24:29	0|kallewoof|s/which might mean/which might indicate/
29 2017-09-01 06:37:07	0|meshcollider|Since #11171 is being used to discuss the GUI bug could someone please reopen it :)
30 2017-09-01 06:45:21	0|meshcollider|Thanks sipa
31 2017-09-01 06:45:52	0|sipa|yw!
32 2017-09-01 06:50:52	0|gmaxwell|kallewoof: it will fetch parents but its pretty limited in doing that. It won't fetch things that it just wasn't online to see.
33 2017-09-01 06:50:58	0|gmaxwell|unless a child shows up.
34 2017-09-01 06:51:30	0|gmaxwell|in my expirence it normally takes about 24 hours of operation before compact blocks reaches its full hitrate.
35 2017-09-01 06:52:22	0|gmaxwell|and right now with a flood of very low fee txn you won't pick those up.
36 2017-09-01 06:57:48	0|jimpo|kallewoof: Do you mind dumping the mempools and sharing if you have RPC enabled? I'd be interested in taking a look.
37 2017-09-01 07:01:23	0|gmaxwell|kallewoof: fwiw, it's a couple line patch to use the mempool rpc to cause a peer to inv you their whole mempool, it's pretty abusive so you should probably only do it to your own nodes. (e.g. make a patch that adds an rpc command to send a mempool message to a particular node id then use it)
38 2017-09-01 07:01:34	0|gmaxwell|(or at least use it sparingly against anyone else.)
39 2017-09-01 07:20:08	0|kallewoof|jimpo: lemme see what they look like now after the rush of 8k txs first..
40 2017-09-01 07:20:23	0|kallewoof|gmaxwell: ahh okay. well, i kind of want these nodes to behave as a normal average joe node so i don't want them to "cheat"
41 2017-09-01 07:20:59	0|gmaxwell|kallewoof: sure, depends on what you're testing.
42 2017-09-01 07:22:24	0|kallewoof|jimpo: they seem to be a bit closer to what you'd expect now. {11022, 9101, 8525} txs for {69, 13, 17} connection count. still interested?
43 2017-09-01 07:23:20	0|gmaxwell|connection count won't matter.
44 2017-09-01 07:23:34	0|kallewoof|I assumed connection count would give you better coverage
45 2017-09-01 07:23:35	0|gmaxwell|just having been online to see the whole backlog matters mostly.
46 2017-09-01 07:23:55	0|gmaxwell|no, except with very few good peers or something everything gets flooded to every link.
47 2017-09-01 07:24:04	0|gmaxwell|but old transactions are not sent.
48 2017-09-01 07:24:14	0|jimpo|kallewoof: Yeah, I'm still interested. I'll see if I can replicate too, but your nodes have been up a lot longer.
49 2017-09-01 07:24:23	0|kallewoof|one has only been up ~24h
50 2017-09-01 07:24:48	0|kallewoof|would getrawmempool output be enough or do you want more details?
51 2017-09-01 07:25:00	0|jimpo|getrawmempool is great
52 2017-09-01 07:25:07	0|gmaxwell|so you don't see things that were broadcast before you came online, except where they get pulled in by children. or by an occasional piece of 'helpful' custom software that connects to you and vomits a bunch of old txn at you for inexplicable reasons.
53 2017-09-01 07:26:20	0|jimpo|Yeah, that's probably why
54 2017-09-01 07:29:07	0|kallewoof|jimpo: https://bc-2.jp/grm.zip
55 2017-09-01 07:30:44	0|kallewoof|gmaxwell: I thought txs were relayed randomly to enhance privacy
56 2017-09-01 07:30:52	0|kallewoof|I must've gotten that mixezd up with something else.
57 2017-09-01 07:38:16	0|kallewoof|Hum. I don't think that's my issue, but if someone sent a tx with a fee so low it wouldn't go into mempoo, and someone else CPFP'd that, it wouldn't go into the mempool because parent was rejected, I think. That might not be ideal.
58 2017-09-01 07:42:03	0|gmaxwell|kallewoof: you can't use CPFP to evade mempool minimums but they are very low.
59 2017-09-01 07:42:24	0|gmaxwell|kallewoof: they are relayed with randomized delays, in sorted order, but all are relayed.
60 2017-09-01 07:43:07	0|kallewoof|gmaxwell: OK, so that wouldn't explain the difference unless there had been a ton of new txs recently (which wasn't the case at the time).
61 2017-09-01 07:43:20	0|gmaxwell|kallewoof: also peers (well, later than 0.12) will not relay you txn which are too low to go into your mempool.
62 2017-09-01 07:44:53	0|gmaxwell|kallewoof: you can look at the recieved times on all the txn in your mempools, I expect that what you will find that all the txn missing from your lower uptime nodes have recieve times before it started.
63 2017-09-01 08:06:58	0|kallewoof|gmaxwell: That's a good idea, yeah.
64 2017-09-01 10:53:06	0|meshcollider|I've noticed src/test/testutil.cpp|h seem to basically provide nothing, is there anything wrong with removing those files and calling fs::temp_directory_path() directly instead of GetTempPath() ?
65 2017-09-01 11:22:43	0|bitcoin-git|[13bitcoin] 15MeshCollider opened pull request #11210: Stop test_bitcoin-qt touching ~/.bitcoin (06master...06201708_qt_test_dir) 02https://github.com/bitcoin/bitcoin/pull/11210
66 2017-09-01 14:09:24	0|bitcoin-git|[13bitcoin] 15jjz opened pull request #11212: Change the type of BlockStatus to unsigned int  (06master...06master) 02https://github.com/bitcoin/bitcoin/pull/11212
67 2017-09-01 14:31:19	0|bitcoin-git|[13bitcoin] 15jnewbery opened pull request #11213: Fix getrawtransaction help for per-txout chainstate db (06master...06getrawtransactionhelp) 02https://github.com/bitcoin/bitcoin/pull/11213
68 2017-09-01 16:10:57	0|bitcoin-git|[13bitcoin] 15jnewbery closed pull request #11213: [trivial] [rpc] Fix getrawtransaction help for per-txout chainstate db (06master...06getrawtransactionhelp) 02https://github.com/bitcoin/bitcoin/pull/11213
69 2017-09-01 16:52:35	0|bitcoin-git|[13bitcoin] 15MarcoFalke pushed 6 new commits to 06master: 02https://github.com/bitcoin/bitcoin/compare/d81dccf191a4...28f788e47e58
70 2017-09-01 16:52:36	0|bitcoin-git|13bitcoin/06master 1436b6268 15John Newbery: [tests] TestNode: separate add_node from start_node...
71 2017-09-01 16:52:36	0|bitcoin-git|13bitcoin/06master 14be2a2ab 15John Newbery: [tests] fix - use rpc_timeout as rpc timeout
72 2017-09-01 16:52:37	0|bitcoin-git|13bitcoin/06master 146cf094a 15John Newbery: [tests] Avoid passing around member variables in test_framework
73 2017-09-01 16:53:18	0|bitcoin-git|[13bitcoin] 15MarcoFalke closed pull request #11121: TestNode tidyups (06master...06test_node_tidyups) 02https://github.com/bitcoin/bitcoin/pull/11121
74 2017-09-01 17:10:38	0|bitcoin-git|[13bitcoin] 15practicalswift closed pull request #11190: [tests] Remove unused imports (script.OP_0 and script.sha256) (06master...06remove-unused-import-op_0) 02https://github.com/bitcoin/bitcoin/pull/11190
75 2017-09-01 17:54:52	0|GAit|jnewbery: thanks for the more feedback, updated the PR let me know if/when you want me to squash
76 2017-09-01 18:07:22	0|paveljanik|Please close #11202
77 2017-09-01 18:21:01	0|jnewbery|MarcoFalke : silent merge conflict for #11121 :( I'll open a fixup PR
78 2017-09-01 18:21:24	0|jnewbery|(bitcoin_cli.py didn't have the set_test_params() override)
79 2017-09-01 18:26:02	0|bitcoin-git|[13bitcoin] 15jnewbery opened pull request #11215: [tests] fixups from set_test_params() (06master...06bitcoin_cli_set_test_params) 02https://github.com/bitcoin/bitcoin/pull/11215
80 2017-09-01 18:26:30	0|jnewbery|#11215 fixes it. Master won't be able to pass travis until that's merged.
81 2017-09-01 18:27:06	0|jnewbery|wumpus sipa ^^ 2 line change in test file - can review/merge please?
82 2017-09-01 22:52:22	0|bitcoin-git|13bitcoin/06master 143918d93 15John Newbery: [tests] fixups from set_test_params()
83 2017-09-01 22:52:22	0|bitcoin-git|[13bitcoin] 15sipa pushed 2 new commits to 06master: 02https://github.com/bitcoin/bitcoin/compare/28f788e47e58...ec20f01ba094
84 2017-09-01 22:52:23	0|bitcoin-git|13bitcoin/06master 14ec20f01 15Pieter Wuille: Merge #11215: [tests] fixups from set_test_params()...
85 2017-09-01 22:53:03	0|bitcoin-git|[13bitcoin] 15sipa closed pull request #11215: [tests] fixups from set_test_params() (06master...06bitcoin_cli_set_test_params) 02https://github.com/bitcoin/bitcoin/pull/11215