Get a cardboard box slightly larger than your casserole. Line the box with a bath or beach towel and place the casserole (covered of course!) on top. Then back extra dish towels on either side of the casserole and cover the rest with another large bath or beach towel.
The towels will not only keep your dish hot until you get to the potluck, but it will also soak up any spills