Preheat oven to 375 degrees. Spray 8x8 casserole dish with cooking spray.
Crush 3/4 sleeve of crackers into the bottom of the casserole dish. Place 5-6 slices of butter on top of the crackers.
Open oyster pints and drain, reserving ½ cup of the oyster liquid. Add a layer of oysters over the cracker bed in the casserole dish and sprinkle with pepper. Repeat layers ending with crackers.
Pour oyster liquid over the top first and then add the heavy cream.
Cover and bake for 35 minutes. Remove the cover for the remaining 15 minutes. If needed, place under the broiler to brown the top.