Use pry bar carefully pry around, you can remove both sides of the door handle.

There is usually a plastic washer between the handle and the door, taking care not to damage it.

There will be a metal square shaft connected between the handle. Be careful not to lose it when removing the inside handle because the shaft is inside and outside.