Have you looked at the mempool lately?
https://jochen-hoenicke.de/queue/#1,1yIt's as empty as it can get. So no, we are far from having real scalability problems. These big ass peaks were obviously abnormal behaviour, either be by exchanges not properly batching transactions, Roger Ver and Jihan Wu spamming the network, and so on. Add in segwit and the mempool is empty. Transactions are now fast and cheap.
We don't need to rush things in order to accommodate a "mainstream demand" which simply doesn't exist, otherwise BCash would have full blocks as well Bitcoin itself. Censorship resistant and robust of the system > rushing things scaling wise.
The last "peak" lasted for months, even being from spamming the network, it did negatively affect bitcoin, and increasing the tx capacity would make such spamming attacks harder to achieve and less effective. I'm not asking for bitcoin to handle as many transactions as paypal, but I am hoping for such peaks to never happen.
I have near to zero technical knowledge so I can't say if LN development is going faster or slower than it should be. But I can't see how a faster adoption of SegWit would be "rushing things". SegWit is fully developed and it's the responsibility of wallets, exchanges and other services to start supporting it.
If you want to help learn to code and drop good BIPs
I might actually do it :p
I have some knowledge in programming languages like C++ and java, but I don't know what you meant here by "learn to code", do you know where can I start?