As long as you meet the requirements...
Requirements: To qualify as a Spell Sword, a character must fulfil all of the following criteria: Base Attack Bonus: +4 Skills: Lore 6 Feats: Must be proficient in simple and martial weapons as well as all forms of armor use Special: Must be able to cast level 2 or higher arcane magic
...being wizard until you meet the requirements and start taking your Spellsword levels is probably fine. However simple weapons, matial weapons, light-medium-heavy armor is five feats you'll have to take right there. So most just take five wizard, five fighter, and the rest Spellsword. ZV-