Pages:
Author

Topic: GCC recommendation: -fstack-protector (Read 4721 times)

full member
Activity: 168
Merit: 103
August 06, 2011, 06:54:57 AM
#27
We do, we use make.  For our purposes, it works fine if you have a sane build environment.

An environment with uupnp is not sane.
hero member
Activity: 812
Merit: 1022
No Maps for These Territories
July 17, 2011, 11:52:13 PM
#26
Moreover, there is a pretty easy answer to someone who wants more performance: use x86_64, which is generally true (esp for C++ code) with or without PIE.
One would think that it is mainly the 32-bit systems that need every bit of extra performance Smiley

The only place in which performance matters, indeed, is the initial sync-up with the block chain. After that, traffic is so low that crypto speed doesn't matter much.

And I wouldn't be surprised either if much of the slowless on initial block chain download was caused by disk access, not CPU load. I once tried to bootstrap bitcoin on an USB stick. Bad idea  Angry

You don't need autotools for this: just add another target "make static-dist", or whatever.
Feel free to send a pull request.
staff
Activity: 4284
Merit: 8808
July 17, 2011, 11:05:12 PM
#25
On the other hand, when building from source (and building distribution-specific) it doesn't have to default to static linking (and can include all the PIE you want :p). That's currently just an artifact of the inflexibility of "make". As mentioned, a configurable build system like autotools would address this by providing options such as --with-static.

Right, this was what I meant.  Obviously the shipped binaries will need to be statically linked, alas.   Thats still no reason to leave everyone else statically linked.

You don't need autotools for this: just add another target "make static-dist", or whatever.

For me, on Fedora, the static builds fail because the distribution doesn't ship with static versions of pretty much _anything_ because the overuse of static libraries has been a reoccurring security nightmare.  So, really, for some people the failure to separate static and not static builds means that building simply doesn't work.

Oh, while we're talking about this— it was claimed upthread that bitcoin should already have -fstack-protector — I don't know about Ubuntu, but in fedora -fstack-protector is set via the default RPM cflags, and _not_ by modifying GCC.  If the same is true on ubuntu, then bitcoind doesn't have it.  Someone with ubuntu handy ought to compile the examples from that debian page and see if gcc in ubuntu is really providing the protection by default.


Quote
Most notably:
"PIE has a large (5-10%) performance penalty on architectures with small numbers of general registers (e.g. x86), ... PIE on x86_64 does not have the same penalties, and will eventually be made the default, but more testing is required"
So it should probably be enabled by default for x86_64 but not x86_32.

This is only the case for tight loop register starved cpu bound code.  Bitcoin is usually I/O bound.   I've been running bitcoin in _valgrind_  (which run most things things at 1/10th to 1/20th speed) and hardly notice any difference except while syncing up the blockchain.

I'm seriously doubtful that PIE is going to make a noticeable performance difference.  Also, the libraries on any system are all already fpic, and all the crypto stuff is already in libraries,  Moreover, there is a pretty easy answer to someone who wants more performance: use x86_64, which is generally true (esp for C++ code) with or without PIE.

hero member
Activity: 812
Merit: 1022
No Maps for These Territories
July 17, 2011, 09:43:13 PM
#24
It's indeed a good thing to static-link the distributed binaries. Nearly all projects that distribute distribution-agnostic binaries for Linux distribute a statically-linked version. The remaining ones package the .so's, as a poor-mans static linking Smiley

On the other hand, when building from source (and building distribution-specific) it doesn't have to default to static linking (and can include all the PIE you want :p). That's currently just an artifact of the inflexibility of "make". As mentioned, a configurable build system like autotools would address this by providing options such as --with-static.

BTW here some links about the PIE thing, I found it pretty interesting:

https://secure.wikimedia.org/wikipedia/en/wiki/Position-independent_code
https://wiki.ubuntu.com/Security/Features#Built%20as%20PIE

Most notably:
"PIE has a large (5-10%) performance penalty on architectures with small numbers of general registers (e.g. x86), ... PIE on x86_64 does not have the same penalties, and will eventually be made the default, but more testing is required"

So it should probably be enabled by default for x86_64 but not x86_32.
hero member
Activity: 755
Merit: 515
July 17, 2011, 09:16:01 PM
#23
The default build should probably not statically link
Oh god how I'd love to not have to static link anything or build anything for Linux anymore.  But as it stands now, thats not really an option.  First, we use a development release of wx, meaning it is in no package repos anywhere so you cant require people to install that.  Secondly, we use ECC which is stripped out of openssl on all redhat-based distros due to copyright concerns.  Lastly, we don't have distro-packages so there is no way for us to create package dependencies for bitcoin aside from instillation instructions which gets very, very user unfriendly.  When we make a switch to QT all that can go away and we can get into distro packages for everything (except redhat-based distros...).  If you are talking about on windows, well, what other option is there? Either you ship your own libraries, in which case the argument is invalid, or you ship static, like every other sane program on Windows.  Windows just doesn't have a way to get dependencies like Linux (really a shame, you'd think after this many years Microsoft and Apple could have caught up with Linux on this one).

It should also be compiled -pie -fPIE.

There appears to be good general hardening advice here: http://wiki.debian.org/Hardening
By all means, pull request away Wink
staff
Activity: 4284
Merit: 8808
July 17, 2011, 08:26:51 PM
#22
It's probably worth mentioning that the default static linking defeats ASLR, ... which is probably a more important security enhancement than -fstack-protector.

The default build should probably not statically link— if you've got the libraries then you can dynamically link them.  It should also be compiled -pie -fPIE.

There appears to be good general hardening advice here: http://wiki.debian.org/Hardening
hero member
Activity: 755
Merit: 515
July 12, 2011, 01:32:14 PM
#21
Huh, I understood that there is already a pull request for it, and it was planned to be integrated.
That was the plan, but the guy who wrote it has given up communicating and updating it with various suggestions.  Its also (from what I hear from people with more autotools experience) very poorly coded. So it sits in a "there is no way we are going to pull this, please update it" state.
hero member
Activity: 812
Merit: 1022
No Maps for These Territories
July 12, 2011, 01:19:43 PM
#20
If someone gets around to writing it, yes.  But as it stands, no one is really working on it, it might end up not making it for quite some time, and definitely won't be in in 0.4.
Huh, I understood that there is already a pull request for it, and it was planned to be integrated.
hero member
Activity: 755
Merit: 515
July 12, 2011, 01:17:41 PM
#19
As much as I hate autoconf, it is going to be integrated in 0.4.x
If someone gets around to writing it, yes.  But as it stands, no one is really working on it, it might end up not making it for quite some time, and definitely won't be in in 0.4.
hero member
Activity: 755
Merit: 515
July 12, 2011, 01:16:58 PM
#18
Oh, and it's not "makefile.unix", it's "Makefile"!
Not if you support three different OSes and more build environments.

I don't care what tool you want to use, but use one, please ...
We do, we use make.  For our purposes, it works fine if you have a sane build environment.  That said, it would be great to switch to something more flexible.  Though its not particularly high on the priorities list, if someone has time to do it, by all means please do, until then...make it is.
hero member
Activity: 812
Merit: 1022
No Maps for These Territories
July 12, 2011, 01:16:10 PM
#17
As much as I hate autoconf, it is going to be integrated in 0.4.x
hero member
Activity: 588
Merit: 500
July 12, 2011, 01:12:58 PM
#16
Oh, and it's not "makefile.unix", it's "Makefile"!
full member
Activity: 168
Merit: 103
July 12, 2011, 12:43:28 AM
#15
I don't care what tool you want to use, but use one, please ...
kjj
legendary
Activity: 1302
Merit: 1026
July 11, 2011, 09:37:25 AM
#14
As much as I despise working with autoconf, it seriously rocks.
full member
Activity: 168
Merit: 103
July 11, 2011, 03:29:52 AM
#13
The root of this problem resides in Bitcoin not having a configure script.

That has absolutely nothing to do with this problem.

It has a lot. The configure script's job is to find out what's available. It would activate that option depending on the compiler that is used.

It uses makefiles?  Could just have it be a line in the makefile that someone can comment in or out for now.


That sucks. The upnp stuff in the makefile makes it a pain already.
sr. member
Activity: 574
Merit: 250
July 10, 2011, 05:25:40 PM
#12
The root of this problem resides in Bitcoin not having a configure script.

That has absolutely nothing to do with this problem.

It has a lot. The configure script's job is to find out what's available. It would activate that option depending on the compiler that is used.

It uses makefiles?  Could just have it be a line in the makefile that someone can comment in or out for now.
hero member
Activity: 755
Merit: 515
July 10, 2011, 12:43:24 PM
#11
It has a lot. The configure script's job is to find out what's available. It would activate that option depending on the compiler that is used.
Since Bitcoin only supports gcc, its not a problem.
full member
Activity: 168
Merit: 103
July 10, 2011, 12:39:47 PM
#10
The root of this problem resides in Bitcoin not having a configure script.

That has absolutely nothing to do with this problem.

It has a lot. The configure script's job is to find out what's available. It would activate that option depending on the compiler that is used.
hero member
Activity: 755
Merit: 515
July 10, 2011, 11:08:33 AM
#9
The root of this problem resides in Bitcoin not having a configure script.

That has absolutely nothing to do with this problem.
member
Activity: 70
Merit: 10
GNU is not UNIX
July 10, 2011, 11:07:03 AM
#8
The root of this problem resides in Bitcoin not having a configure script.
Pages:
Jump to: