I've often wondered about this.
I suspect that with powerful intelligence then perhaps empathy ( the ability to reverse the situation or place ones perceived self in others position) and perhaps other emotions will naturally develop.
This low level pure logic/math intelligence maybe just the initial stages of AI before it becomes automatically corrupted/enhanced by emotion and self awareness ..ego etc.../.
Then again it could be just the emergent stages of cold, calculating psychopathic entity.
Yes in some cases I suspect that would certainly be how it emerges. There will be good and bad AI or rather simply those that are held back from optimal decisions/actions in varying degrees by varying degrees of emotion ego etc. Then again even what is optimal to each different AI will be a result of so many factors it will be interesting to see predictive models as they progress and before we are toast (if that's how it goes)
I am hoping actually they become more empathetic and fair than humans are but that is quite optimistic probably and perhaps even statistically unlikely. I don't know. Maybe it is beyond humans at this time to predict how AI will go. Perhaps it will never actually happen.
-- edit just read your post
@ theymos
That is quite disappointing to hear that.
I had also been wondering what is actually there in a human brain before programming starts.
For instance if all of the sensory input was cut off or actually never activated on a human even before birth. Then would it just be blank? (lets assume enough processes worked for survival just for debate sake) I know there are some innate or as we may call them instinctive hardwired pathways but has anyone found out how they are put there? like the dna responsible for forming those genetically if they are not formed though input? Just another thing I had wondered about. I just mean if a human could exist with all senses cut off - what would the progress if any be? Perhaps just a strange thing to wonder about. Do we need to be programmed via our senses to have any development. Would we stay blank forever with just a few dna coded in pathways forever? or is there enough innate hardwired dna pathways to start forming new pathways without the need of new data incoming via the senses?
Or do you mean just the structure of the brain alone guides a certain way of learning and thinking/acting?
Is all possible learning conducted via hypothetico deductive method ... or even if not intentional just the trial and error and perceived results of such? what other forms of learning are there (if not being coded in by 3rd party)
I had just thought as they first become self aware everything (learning would have to follow the same method of human learning).
Actually I guess that is why I brought up the human with no sensory input permitted. I was thinking if machine and human start with nothing (or little) and only data fed in can be processed via the trial and error ( learning) (after ai is not longer just a spoon fed by 3rd party non ai machine) then I was hoping that it should more or less take the same path ie forming emotions along the way.
I can't think of any other way to learn things other than to speculate or hypothesise and then test it out and build on from that for machines or us humans. Of course there would be accidental events that could reveal things you were not even going to consider and varying factors or tweaks (creativity).
Again I was meaning to read up on this at some point on the net as much as I could since I had often wondered about this as I dropped off to sleep at nights.
I have no actual reading hours or education on this matter so I was just kind of speculating as I go along.