Standing stone locations

The Apprentice Stone: It is south of Solitude, on an island, in a small water marshland. It helps you recover magicka quickly, but it makes you susceptible to magicka damage.
The Atronach Stone: It is between Riften and Windhel, in the marshland. It is just outside the mountain range between the two locations, near the Eldergleam Sanctuary and Darkwater Crossing by the river to the east of the two. It gives you a large magicka boost and enables you to absorb spell damage, but you recover it slowly.
The Lady Stone: It is on a small island on the lake to the west of Riverwood. It allows you to regenerate health and stamina quickly.
The Lord Stone: It is southwest of Dawnstar, in the mountain range, on the northern peak. It makes you resistant to magicka and physical damage.
The Lover Stone: It is east of Markarth, about one fifth of the way to Solitude. It helps you improve all your skills faster.
The Ritual Stone: It is east of Whiterun, south of the river, between Whiterun and Valtheim Towers. It allows you to re-animate nearby corpses to fight for you.
The Serpent Stone: It is east of Winterhold, north of Windhelm, in the sea, on a floating ice berg. It gives you a ranged paralyzing poison to use once a day.
The Shadow Stone: It is south of Riften, on a small mountain before the large mountain range to the south. It lets you become invisible once a day for an extended period.
The Steed Stone: It is on the tip of the highest mountain, northwest of Solitude. It increases your carrying capacity without any movement penalty.
The Tower Stone: It is on a mountain in the middle of Winterhold and Dawnstar. It allows you to automatically open expert and lower locks.