Is it possible to delete the record of approved/applied leave from the system?

No, You cannot delete approved or applied leave records from the system.
You can cancel the leave and reapply.