Argonian
+10 Lockpicking, +5 Restoration, Alteration, Light Armor, Sneak, Pickpocket
Histskin : Invoke the power of the Hist to recover health ten times faster for 60 seconds.
Resist Disease : Your Argonian blood is 50% resistant to disease.
Water Breathing : Your Argonian Lungs can breath underwater.
Breton
+10 Conjuration, +5 Alchemy, Illusion, Restoration, Alteration, Speech
Dragonskin : Absorb 50% of magicka from hostile spells for 60 seconds.
Magic Resistance : Breton blood grants a 25% resistance to magic.
Dunmer (Dark Elf)
+10 Destruction, +5 Alchemy, Illusion, Alteration, Light Armor, Sneak
Ancestor’s Wrath : For 60 seconds, opponents that get too close take 8 points per second of fire damage.
Resist Fire – Your Dunmer blood gives you 50% resistance to fire.
Altmer (High Elf)
+10 Illusion, +5 Conjuration, Destruction, Restoration, Alteration, Enchanting
Highborn : Regenerate magicka faster for 60 seconds.
Highborn : High Elves are born with 50 extra magicka.
Imperial
+10 Restoration, +5 Destruction, Enchanting, Heavy Armor, Block, One-Handed
Voice of the Emperor : Calms nearby people for 60 seconds.
Imperial Luck : Anywhere gold coins might be found, Imperials always seem to find a few more.
Khajiit
+10 Sneak, +5 Alchemy, One-Handed, Archery, Lockpicking, Pickpocket
Night Eye : Improved night vision for 60 seconds.
Claws : Khajiit claws do 15 points of damage.
Nord
+10 Two-Handed, +5 Smithing, Block, One-Handed, Light Armor, Speech
Battle Cry : Target flees for 30 seconds.
Resist Frost: Your Nord blood gives you 50% resistance to frost.
Orsimer (Orc)
+10 Heavy Armor, +5 Enchanting, Smithing, Block, Two-Handed, One-Handed
Berserker Rage : You take half damage and do double damage for 60 seconds.
Redguard
+10 One-Handed, +5 Destruction, Alteration, Smithing, Block, Archery
Adrenaline Rush : Stamina regenerates 10x faster for 60 seconds.
Resist Poison : Your Redguard blood gives you 50% resistance to poison.
Bosmer (Wood Elf)
+10 Archery, +5 Alchemy, Light Armor, Sneak, Lockpicking, Pickpocket
Command Animal : Make an animal an ally for 60 seconds.
Resist Disease and Poison : Your Bosmer blood gives you 50% resistance to poison and disease.
Every character starts with these two spells:
Flames : A gout of fire that does 8 points per second. Targets on fire take extra damage.
Healing : Heals the caster 10 points per second.
Breton's also start with...
Conjure Familiar : Summons a Familiar for 60 seconds wherever the caster is pointing.
Dunmer also start with...
Sparks : Lightning that does 8 points of shock damage to health and magicka per second.
Altmer also start with...
Fury : Creatures and people up to level 6 will attack anything nearby for 30 seconds.
Just to clarify, these spells are available to any race in the game. The races listed just start with those spells as a bonus for their +10 proficiency in certain magics.