A new finite difference scheme is applied to solve partial differential equations in domains with discontinuities due to the presence of time dependent moving or deforming interfaces. This scheme is an extension of the finite difference idea developed for solving incompressible, steady stokes equations in discontinuous domains with fixed interfaces [1]. This new idea is applied at the irregular points at each time step in conjunction with the Crank-Nicolson (CN) implicit scheme and a recently developed Higher Order Compact (HOC) scheme at regular points. For validation, Stefan's problem is considered with a moving interface in one dimension. In two dimensions, heat equation is considered on a square domain with a circular interface whose radius is continuously changing with time. HOC scheme is found to produce better results and the order of accuracy is slightly better than that of the CN scheme. However, both the schemes show around second order accuracy and good agreement with the analytical solution.