Toss potatoes into a large bowl with salt and pepper and a little olive oil. Put onto sheet tray and roast in a 325 degree oven until golden brown, about 20 minutes. Cut potatoes into bite size pieces. Put olive oil, asparagus, garlic, and shallots into a large saut pan and saut until asparagus starts to cook. Add potatoes and mix until warm.