I chose a Mage on my third playthrough , and it really does no matter where you put your points as long as you have at least Quen level 2 , all vigor points ( 7 vigor is achievable , 1 in training tree , 3 in magic tree , and 1 vigor through Maribor forest ) , and the heliotrope , as well as concentration mutagens to boost
Sign intensity is worth it if you use ignii a lot ( enemies are incinerated for a bit longer ) , otherwise if you use mainly Quen and Aard , better go for venting and sign damage
If you make a "pure" witcher mage , the difficulty is in act 2 when you are impersonating Seltirk before the Draug fight , with 0 points in swordmanship , this is the hardest moment in the game by Far with a pure mage since you can't use magic nor potions , in harder difficulties , it is a nightmare
Hence i would advise you to never go pure mage but rather choose a specialty in magic (let's aard ) and boost all the damage and sign intensity , get all vigors + heliotrope , then go invest a few points swordmanship (particularly the vigor regen ... the riposte and the ability that makes you able to lose only half a vigor when blocking , so in effect , it doubles your vigor when you don't use sign , very useful )
In any case , the most powerful build i had was when going alchemy mainly + swordmanship , i had 10 mutagens with doubled power , as if i had 20 greater mutagens , add to that the uber potions and oils as well as the massive vigor regen and beserk bonus of the alchemy tree , ( with just 6 to 8 points in sword , you can still stack the +dmg talent of alchemy+sword tree and the vigor regen which makes you completely Overpowered when you add , trophies , superior armor and weapons into the equation , not to mention bombs (zerrikanian sun for crowd control , poisoned daggers for bosses or traps )
My pure mage was the weakest of all my 4 playthroughs so far , first time i did a balanced character sword + magic , second time i did a pure swordsman , third time a pure mage , my fourth with mainly alchemy + sword was the most baddass because of the mutagens and bonus of alchemy+sword stacking and drinking 4 very powerful potions all the time with improved oils as well .
However , if Alchemy build is the most powerful when you want to min+max , it is also with the Pure mage , the most difficult to play before you hit level 20+ , because it is only when you apply all the mutagen and upgraded your tree deep enough that you become powerful (rather late in fact ) , whereas with my pure swordsman , it was easy all the way , from the start to the end of the game