Uber rating

My passenger rating has been stuck at 4.85 for nearly 3 years. I go from using the app maybe once a month to using it 4-5 times a week for several months. Currently with my new job I have been taking it 4-5 times every week for the past 2 months and each trip is $42. I'm always outside waiting for my driver before they arrive and never talk (outside of hi, how are you, thank you, take care) unless they prompt a convo first. And then yesterday after one typical trip it went down to 4.84. The last trip was pretty silent but I know the two previous drivers liked me because they made an effort to talk and specifically told me they would give me a 5 star. I don't know why it even bothers me but it is frustrating never seeing my rating change then after this long only go downward. I feel like there is no pleasing Toronto uber drivers. I even offer to let driver's take personal calls when their phone rings, always tell them I'm fine with whatever music or temperature they prefer when they ask etc. Anyway that is my rant. Can anyone possibly explain how my rating never changes in the first place after so many trips? Am I getting an even balance or 4's and 5's for the most part and then maybe a 1 star for the last guy from the last guy for no good reason lol...