Line 9 inch square pan with whole graham crackers, breaking crackers if necessary to fill bottom of pan. Combine pudding mix and milk in bowl. Beat slowly with rotary beater or at lowest speed of electric mixer, about 2 minutes. Let stand 5 minutes, then blend in whipped topping.
Spread half the pudding mixture over layer of crackers. Add another layer of crackers and top with remaining pudding mixture. Add another layer of crackers and top with cherry pie filling. Chill 3 hours.