Your first chameleon will always have a place in your heart. Even if your not sure what you are doing yet. Even if circumstances are less then ideal, the first anything you have come into your life is memorable and important.
My First monitor lizard came to me malnourished, "highly aggressive" according to the store, and apparently was a lost cause.... She also had brain parasites... But if it weren't for her, i wouldn't have my love of reptiles or any experience with dealing with a challenging, special needs (in the end) reptile, Plus i am absolutely in love with monitors now.
the point of all this is that you should give your chameleon a chance, Give him the best you can and grow together.
Also, in my opinion, although he is getting older.. an adult chameleon ( maybe not an older one necessarily ) would handle the " Learning Curves" of Reptile ownership, let alone chameleon ownership much better then how a young baby chameleon whom is more sensitive would handle things.
I could however totally be wrong on that since i don't know how tolerant a 3 year old veil is compared to a 1-2 year veil is.
Anywho , that's my opinion.