What I normally take into the Sierra that time of year is:
- Long pants and sleeves for hiking (sleeves can be rolled up). It won't be that hot then. Shorts might work for a short period of the day, but for me, not enough to justify them.
- Lightweight thermals for sleeping and early morning hiking. And evening if you hike late.
- Rain jacket (use the same jacket as you) and lightweight rain pants or full length rain skirt.
- Montbell plasma 1000 down jacket. Don't like hoodys because you can't wear the hood without jacket. I often wear my warm hat in the mornings when it's too hot to hike in the jacket.
- MLD rain mitts. Provide good warmth for the 1oz weight and keep your hands dry in snow or during a thunderstorm. Wet glove liners and strong cold winds don't work well.
- Hat for sun as you'll often be in direct sunlight.
- Lightweight balaclava as a warm hat. They can be worn in a variety of ways depending on how much warmth you need. And as a quilt user instead of a mummy bag, being able to pull it all of the way down is a great bonus.
Nothing you are suggesting won't work if you are familiar with their performance.