Is your issue more with how to handle that orange note or just the overall speed & complexity that happens? If it's in handling that 5th fret button with 4 fingers I had to do something that may not be common for a lot of players but helped me beyond people just saying, "Oh, play on Expert and Hard will seem easy," or, "Just keep playing and you'll get better."
When playing Easy or Medium most people tend to have their index finger on green, middle on red, ring on yellow, pinkie on blue. I actually went back down to Easy level and "retrained" my brain to have my "home" position be middle finger on yellow. The reason being is that the index finger can reach much easier than your pinkie. Basically what ends up happening for me is that I cover red and green with my index finger. Obviously in some songs you can't ONLY do red & green with the index but once I readjusted my brain to the new home position, again, by going back to Easy until I was around 100% on songs, then Medium, finally when I went to Hard it wasn't nearly as difficult since now my pinkie was already in position to handle those pesky orange notes.
Again, this technique won't work for everyone but it's what helped me. :-)