1 2017-01-07 02:09:34 0|gmaxwell|morcos: actually the parallel signature checking gains are better than expected. So consider (all reindex chainstate, dbcache2000) no-scriptchecks par=4 10680.346728 seconds, all scriptchecks par=4 24453.715550 , all scriptchecks part=default (24 core, 48 thread host): 12182.296543 ... so if you compute (par4-none)/(parN-none) = 9.17 ... impressive trick considering MAX_SCRIPTCHECK_THREADS i
2 2017-01-07 02:09:40 0|gmaxwell|s 16. ... my numbers may not be totally compariable because I had a rebase between the par4 and parN cases, that I didn't _think_ would impact performance.
3 2017-01-07 02:09:53 0|gmaxwell|Good test hygine is hard when doing tests that take 7 hours.
4 2017-01-07 02:12:33 0|Chris_Stewart_5|jonasschnelli: Do you have any numbers on how long it takes to sync headers with your pull req?
5 2017-01-07 02:21:50 0|warren|jonasschnelli: hmm, I'm excited to use your SPV mode in conjunction with BIP150 (authenticated connection to my own full nodes)
6 2017-01-07 02:23:43 0|gmaxwell|warren: just need 5 more regular contributors to get all the outstanding things done.
7 2017-01-07 03:04:49 0|morcos|gmaxwell: i don't think thats a fair calculation though since during the none part the script checking threads are running
8 2017-01-07 03:04:54 0|morcos|or at least N-1 of them
9 2017-01-07 03:06:53 0|gmaxwell|morcos: I agree someone is wrong, but I don't follow your explination. None is effectively fScriptChecks = false. The threads may be running but they're not doing anything.
10 2017-01-07 03:07:21 0|gmaxwell|all is fScriptChecks wedged true. (no checkpoints).
11 2017-01-07 03:08:11 0|morcos|yes but during the all time so take the par=default case.. you have 15 script check threads running for 10k seconds and then 16 running for another 2k seconds, so its not fair to say it only took them 2k seconds
12 2017-01-07 03:09:28 0|gmaxwell|duh right.
13 2017-01-07 03:09:34 0|gmaxwell|okay, it's been a long day.
14 2017-01-07 03:10:11 0|morcos|all this flurry of trying to fix concurrency problems showed up when it turned out that it could actually be faster to NOT have signatures cached because of the contention on the sigcache
15 2017-01-07 03:10:24 0|morcos|thats certainly been fixed with the cuckoocache
16 2017-01-07 03:10:30 0|gmaxwell|well for IBD it still might be. :P
17 2017-01-07 03:11:08 0|morcos|but it is still the case that when sigs are cached, its harder to see the benefits of more parallelism, b/c then the contention on the checkqueue is greater
18 2017-01-07 03:12:31 0|gmaxwell|I wish our design made it easier to get multiple blocks in the scriptchecking pipeline at once.
19 2017-01-07 03:13:20 0|morcos|I suspect that improvement wouldn't be that much any more
20 2017-01-07 03:13:43 0|morcos|with full blocks, there isn't much time where you have idle cores with nothing to do
21 2017-01-07 03:13:58 0|morcos|it makes a much bigger difference with the old small blocks though
22 2017-01-07 03:14:20 0|morcos|i do think if i had your computer i'd change MAX_SCRIPTCHECK_THREADS though!
23 2017-01-07 03:14:32 0|gmaxwell|yes. well, also, I'm usually using 48 or 56 thread hosts.
24 2017-01-07 03:14:42 0|gmaxwell|well it used to make it _slower_ I'm trying now with it at 48.
25 2017-01-07 03:15:57 0|gmaxwell|it's at height 250k at hte moment and not making it much past 700% cpu according to top... but thats still early.
26 2017-01-07 03:16:48 0|morcos|it's worse than video games. you're still going to be doing that at 3am
27 2017-01-07 03:16:51 0|morcos|have a good night!
28 2017-01-07 03:17:27 0|gmaxwell|hah
29 2017-01-07 03:18:11 0|gmaxwell|"I thought mine-craft was a graphical program?"
30 2017-01-07 03:50:33 0|Chris_Stewart_5|How is CScript serialized? It doesn't seem to use ADD_SERIALIZE_METHODS
31 2017-01-07 03:54:04 0|luke-jr|Chris_Stewart_5: it's just a vector of uint8s
32 2017-01-07 04:04:27 0|Chris_Stewart_5|luke-jr: Which is why we things like this? static_cast<const CScriptBase&>
33 2017-01-07 04:09:06 0|sipa|yes CScript is just a subclass of std::vector<char>
34 2017-01-07 04:36:09 0|warren|https://0bin.net/paste/iJSqUPkqv-zAG-ZN#vKw4haQ8j5fbQZK7NAkYO+nXugLmLPZP73uJghKj6nl This is an example of a double-spent transaction, previously confirmed in the local wallet but now invalid. I think years ago this output would continue to show the blockhash of the block that it was previously confirmed (but no longer the longest chain)? Any idea when this changed?
35 2017-01-07 07:42:57 0|sqltest|hello. I'm having a problem getting bitcoind to run as a different user (other than logged in user) using init conf. It always fails because it tries to create a .bitcoin dir. If I create a /.bitcoin dir with ownership of user it works. But I don't want a root .bitcoin dir. The running user has no home dir. The bitcoin.conf is provided on cmd and datadir is in conf so works fine. No need to create an empty .bitcoin dir at a
36 2017-01-07 07:44:59 0|sqltest|eg. "sudo -u btc bitcoind -conf=/etc/bitcoin/bitcoin.conf" works only if an extraneous .bitcoin dir exists even when not used
37 2017-01-07 07:48:11 0|gmaxwell|you need to set the datadir path, not conf.
38 2017-01-07 07:48:45 0|gmaxwell|you can just <sudo...> bitcoind -datadir=/etc/bitcoin/
39 2017-01-07 07:49:46 0|sqltest|I do set that in the conf file and it works. But only when an empty .bitcoin is "hanging around". The .bitcoin remains empty even when daemon is full functionaing.
40 2017-01-07 07:50:17 0|sqltest|I have other settings I need in the bitcoin.conf as well so provide that instead of datadir alone.
41 2017-01-07 07:50:46 0|sqltest|It seems to test the exitence of .bitcoin even when using another datadir path.
42 2017-01-07 07:51:50 0|sqltest|The issue is it is run as btc user by start-stop-daemon but that process chdirs to root first.
43 2017-01-07 07:52:35 0|sqltest|So if I create an empty /.bitcoin dir it starts fine. But when that is not present it cannot start.
44 2017-01-07 07:52:55 0|jonasschnelli|<*highlight> <Chris_Stewart_5:#bitcoin-core-dev> jonasschnelli: Do you have any numbers on how long it takes to sync headers with your pull req?
45 2017-01-07 07:53:02 0|jonasschnelli|2-3min
46 2017-01-07 07:53:16 0|sqltest|If I tell start-stop-daemon to chdir to a writeable dir I thought it would create a .bitcoin dir there but for some reason it doesn't.
47 2017-01-07 07:53:18 0|jonasschnelli|Headers-Sync does not run in parallel (from different peers)
48 2017-01-07 07:53:34 0|jonasschnelli|So.. if you have download them from a slow peer, it may take longer.
49 2017-01-07 07:57:33 0|gmaxwell|sqltest: don't use the config file to set it, thats too late.
50 2017-01-07 07:57:51 0|gmaxwell|hm. well, that might be a bug then.
51 2017-01-07 07:57:54 0|jcorgan|sqltest: i can confirm i've seen exactly the same behavior as you describe. i don't know if it is a feature or a bug, but nowadays i run bincoind inside a container so i map $HOME/.bitcoin inside the container to wherever i want outside the container
52 2017-01-07 07:58:00 0|gmaxwell|though I don't think so.
53 2017-01-07 07:59:04 0|gmaxwell|with datadir set on the commandline I don't see any access to $HOME/.bitcoin
54 2017-01-07 07:59:20 0|gmaxwell|with master, I don't have a 0.13.2 binary handy to test at the moment.
55 2017-01-07 07:59:25 0|jcorgan|i did trace through the code (though this was back in the 0.8 or 0.9 days, so it's probably all changed)
56 2017-01-07 08:00:28 0|jcorgan|and it did seem that bitcoind was checking for $HOME/.bitcoin/bitcoin.conf before parsing the cmdline for -conf
57 2017-01-07 08:01:03 0|sqltest|so I guess i need to set datadir and conf on command line unless I decide to move bitcoin.conf to datadir. I have a bunch of confs for daemons and wanted to keep them all in /etc/bitcoin
58 2017-01-07 08:01:59 0|jcorgan|that's not an unreasonable way of doing things
59 2017-01-07 08:02:34 0|sqltest|well, thanks. I guess I'll have to work around that. The docs seems to say you can set conf on cmdline but that's incorrect unless datadir also provided.
60 2017-01-07 08:02:53 0|gmaxwell|sqltest: yes. you can't even put a datadir in the config of many of the altcoins.
61 2017-01-07 08:04:10 0|gmaxwell|you can set a conf on the commandline. but what you're trying to do is override the conf and datadir at the same time and there is some interaction there it seems.
62 2017-01-07 08:05:27 0|sqltest|Ok. I added datadir so both are provided to start-start-daemon exec args and it works ok like that. I'm creating an install script for my sqlchain daemon and this will work ok. Just need extra arg.
63 2017-01-07 08:06:44 0|sqltest|Thanks for help.
64 2017-01-07 14:57:28 0|Chris_Stewart_5|jonasschnelli: Wow, faster than I expected. Very nice.
65 2017-01-07 15:02:26 0|Chris_Stewart_5|also, it isn't possible to run in parallel is it?
66 2017-01-07 15:09:15 0|gmaxwell|not really without hacks.
67 2017-01-07 16:49:53 0|bitcoin-git|[13bitcoin] 15TheBlueMatt opened pull request #9486: Make peer=%d log prints consistent (06master...062017-01-peer-log-consistency) 02https://github.com/bitcoin/bitcoin/pull/9486
68 2017-01-07 17:50:50 0|bitcoin-git|[13bitcoin] 15droark opened pull request #9487: Remove stray semicolon (Fix empty body warning) (06master...069319Fix) 02https://github.com/bitcoin/bitcoin/pull/9487
69 2017-01-07 18:09:05 0|DrHendrik|Are the last 2 thursday meet-ups skipped because of holidays? or just not updated @ https://bitcoincore.org/en/meetings/
70 2017-01-07 18:09:27 0|sipa|DrHendrik: last thursday there was a meeting
71 2017-01-07 18:09:36 0|DrHendrik|ok
72 2017-01-07 18:09:38 0|sipa|but i think it just has not yet been websiteiified
73 2017-01-07 18:10:38 0|gmaxwell|sipa: it would be nice if this was merged soon, addnode is currently broken in master: https://github.com/bitcoin/bitcoin/pull/9487
74 2017-01-07 18:12:50 0|gmaxwell|I'd really like us to stop using unbraced ifs. This is the kind of error that results from them, it was my screwup for sure, but getting things right is hard enough without a coding style that includes a predictable source of bugs.
75 2017-01-07 18:27:58 0|bitcoin-git|13bitcoin/06master 1425720fc 15MarcoFalke: Merge #9487: Remove stray semicolon (Fix empty body warning)...
76 2017-01-07 18:27:58 0|bitcoin-git|13bitcoin/06master 14cc05896 15Douglas Roark: Remove stray semicolon (Fix empty body warning)...
77 2017-01-07 18:27:58 0|bitcoin-git|[13bitcoin] 15MarcoFalke pushed 2 new commits to 06master: 02https://github.com/bitcoin/bitcoin/compare/46b249e578e8...25720fc394e2
78 2017-01-07 18:28:12 0|bitcoin-git|[13bitcoin] 15MarcoFalke closed pull request #9487: Remove stray semicolon (Fix empty body warning) (06master...069319Fix) 02https://github.com/bitcoin/bitcoin/pull/9487
79 2017-01-07 19:00:16 0|luke-jr|gmaxwell: not sure if I mentioned, but I also came to that opinion following consideration of your arguments for it some months ago (always using braced blocks)
80 2017-01-07 19:00:42 0|luke-jr|and as such have been using/adding them where appropriate
81 2017-01-07 20:26:22 0|gmaxwell|luke-jr: yea, I see you've been using it.
82 2017-01-07 20:26:55 0|gmaxwell|I've been inconsistent in my use in Bitcoin Core, I've slipped some in but worry about getting nagged about the coding style.
83 2017-01-07 20:54:45 0|phantomcircuit|gmaxwell, unbraced if's are just wrong
84 2017-01-07 20:55:30 0|gmaxwell|Unfortunately, I don't think any of the autoformaters or linter tools can enforce them. (they certantly can't enforce my preferred style: unbraced only if the whole statement is one line and there is no else.
85 2017-01-07 21:30:13 0|Chris_Stewart_5|If I am trying to use the 'deserializing constructor' for CTransaction, what am I suppose to be passing in as 'deserialize_type'?
86 2017-01-07 21:30:16 0|Chris_Stewart_5|https://github.com/bitcoin/bitcoin/blob/master/src/primitives/transaction.h#L346
87 2017-01-07 22:30:36 0|max4307|how to reset the password forgot it
88 2017-01-07 22:36:02 0|kadoban|max4307: Password to what? Alse this probably belongs in #bitcoin, at a guess.
89 2017-01-07 22:37:37 0|max4307|the purse has created a password and forgot, you can't work Sneem
90 2017-01-07 22:40:47 0|max4307|encrypted wallet and forgot my password now how to work the ck
91 2017-01-07 22:54:15 0|adam3us|phantomcircuit unbraced if's are very wrong.
92 2017-01-07 22:54:48 0|adam3us|very awesome security defects in other crypto applications have been created by them and poor formatting.
93 2017-01-07 22:55:22 0|sipa|yeah, unfortunately, in some parts of the codebase they're still common
94 2017-01-07 22:55:41 0|sipa|and people tend to (and have been advised to) mimick the style of the code surrounging what is being touched
95 2017-01-07 22:58:16 0|max4307|encrypted wallet and forgot password bitcoincore?
96 2017-01-07 22:59:13 0|sipa|max4307: this channel is not for support
97 2017-01-07 22:59:29 0|sipa|max4307: perhaps try the forums or stackexchange, or #bitcoin (but beware of scammers)
98 2017-01-07 23:01:02 0|max4307|And channel support don't know
99 2017-01-07 23:38:32 0|luke-jr|BlueMatt: we are de facto including wallet/rpcwallet.h in the build already (and forever afaik) with --disable-wallet; how else would you suggest I do that?
100 2017-01-07 23:40:55 0|BlueMatt|oh? where from?
101 2017-01-07 23:41:20 0|BlueMatt|note: I'm ok with a little duplication of the headers with comments noting "this should go away - do not use in new code, yada yada"
102 2017-01-07 23:41:48 0|luke-jr|Makefile.am
103 2017-01-07 23:43:15 0|BlueMatt|you mean via BITCOIN_CORE_H?
104 2017-01-07 23:43:23 0|luke-jr|yeah
105 2017-01-07 23:43:47 0|BlueMatt|afaiu that just informs autotools that if this header changes it may need to recompile some files
106 2017-01-07 23:43:53 0|BlueMatt|it doesnt actually compile/include/etc it in any way
107 2017-01-07 23:45:03 0|luke-jr|it figures out dependencies automatically. although admittedly, I do not know what that reference actually does do
108 2017-01-07 23:46:45 0|luke-jr|in any case, so basically you want me to duplicate the header in src/rpc/?
109 2017-01-07 23:55:41 0|BlueMatt|that would be my preference
110 2017-01-07 23:59:47 0|gmaxwell|phantomcircuit: hm. I thought we had written style mandates that prohibited braces on single line statements. But looking, I can't find that.