I think the problem you have is your mentality toward academia.
I have criticized for years that people treat academia with the wrong attitude. "Back in the day", people went to school to learn. Now, people go to school because they want to go through the motions, blindly often times, and essentially buy themselves a degree... they think they are entitled to college, entitled to a degree, and entitled to the better jobs and better pay that they automatically assume comes with the degree. To hell with the learning. Students are always dumping what they learn after an exam, or after passing a course, or after getting a degree. They barely study, and they play too much, and then they cram. It's not about learning for most of the people who actually want to go to school. And those that don't want to go to school are equally opposed to learning. It's the American way, unfortunately. "Geek" is supposedly a derogatory word, after all.
See, students go to college despite the debt they get into because they believe it will entitle them to better pay. It's a capitalistic game they play. Its a corruption of good moral sense, contrary to the ideal student and the ideal academy. A poor incentive to self-improvement measured not by intellect or skill but by career and income.
Everyone wants that chance in our money-based culture. Society feels morally blackmailed and compelled to give everyone "that chance". And so what happens? Colleges become flooded with applicants, and the quality of the graduate drops. The teachers become overwhelmed and their teaching quality drops further, and the quality of the graduate drops even more. It's an endless cycle.
In order to keep quality high, colleges keep the demand as low as possible... how do they do that? Like any supply-demand system in an economy, they jack up the prices. Students treat academia as a commodity. Schools are forced to do the same over time. We love to criticize colleges for being profiteering, but in reality it is the students fault, it is societies fault... and it is the fault of the employers who would rather hire someone with a degree they don't need, implying skills they don't need, and skills they honestly probably don't even have, instead of the degree-less applicant that actually knows what he is doing.
Here you are. You think college is obligated to give you something... something you're entitled to. But may I point out that whether you're a paying student or just a public library regular, you still have to crack open those books and study on your own either way. The school doesn't teach. The school gives you the means to learn for yourself. Then they grade you and measure your worthiness to move forward. Nothing is stopping you from continuing your education on your own outside of the lesson plan. Why do YOU hold back your own learning? If learning were truly your desire, you wouldn't stop on account of slow classmates. You admit to learning on your own already, but you stop simply because you're in college? That seems like the exact opposite of what you're supposed to be doing.
Here is an important question. Do you actually understand everything you taught yourself? Have you proven the math? Or do you just have a list or procedures memorized? Rote memorization won't get you far, especially in math. Being the best at following the solution processes doesn't make you a good problem solver. Being skilled at solving problems doesn't mean you understand the math behind it, or why the theorems you evoke even work in the first place. You might be one of the top students in some of your classes, but you are certainly not as bright as you think you are. Keep your pride and arrogance in check. No matter what you know or what you think you know, there is always more to know.
You are too focused on who will become a doctorate at a younger age. Why compete like that? It's not about the doctorate. Who cares if they earn their doctorate before you're even done with your bachelors? The fact is, if you are nearly as bright as you claim to be, you will know the material that much better and be that much more prestigious with a doctorate. Rodents with degrees on their walls are still just rodent.
I am like you in many ways. I am an autodidact. I learn a hell of a lot about a hell of a lot. Why? Not because I want a degree but because I want to learn about the world. I am in no rush to graduate. The more time I spend in school, the better..., the more I will learn and the better I will know it. I don't care if people graduate before me. I am still more confident in my skills than they will ever be.
And frankly, I don't mind an easy grade. I get straight A's across the board in nearly every subject. So what if classes are a breeze? All that means is my GPA will be high. And it also means that I have freed up more time during my college semesters to study ahead. Why learn next quarters material next quarter when I could learn it this quarter instead? Why put the burden on myself next quarter to study concepts I don't yet understand when I could just review instead? I for one don't like the challenge created by being pressed for time. I do enjoy the challenge of understanding new concepts though.