Peel and cut potatoes into 1-inch cubes, place in a large pot and cover with water. Bring to a boil and cook until tender. Remove from the heat and drain the potatoes, add butter to the potatoes and thoroughly mash. Add in the eggs, milk, sugar, vanilla, cinnamon and nutmeg; stir to blend well.
Preheat oven to 300°F. Pour potato mixture into a greased casserole dish. Combine topping ingredients and sprinkle over sweet potatoes. Bake for 30 minutes until browned.