If you have a nice thick sturdy putty knife, or a wide based gasket scraper to use to pop it out from the outside, along with a friend pushing from the inside, just be carfull with it and don't apply to much pressure.
When your pushing from the inside, apply as much pressure as you can to the out side perimeter so not to break the glass. The windows will actually take allot of pressure and flex allot but don't push it.
If you have a heat gun or hair dryer it will help to heat the window up so the sealent is softer. Just use your head