Mix pudding with the milk. Add softened ice cream. Pour over the crumbs. Spread Cool Whip over mixture. Sprinkle remaining crackers over top. Put in freezer.
Take from freezer to thaw slightly before serving.