Couple of ways; a standard Evocation Attack against your player's character and try to force a consequence of "out the window". Or an Evocation Maneuver against 3 shifts or against their Athletics skill if higher than Good to place the Aspect of "through the window" on the character.
As for how to do it without magic it would depend on how you did it to determine the skill you would use, Judo throw= Fists, Over the head hoist and heave= Might, Baseball bat swing or throwing something heavy at them= Weapons. If you want to just move them zones then you could roll your attack skill and use a -1 shift to move an opponent through a zone as some knockback provided the attack could conceivably do that.
In the end though it could also just come down to how you want to color the scene, if you just want to do an attack and damage and describe the character as getting blasted through the window go for it. Until you make it an Aspect it's all just color. I had a Wizard blast a Red Court Vampire on a yacht with a Force Blast attack that ended up doing something like 8 stress, I just described the blast as punching the Vampire right through the side of the boat and out into the sun taking it out. I didn't need to make Aspects because the Vampire was toasted anyway and it was a hell of an attack, so why not throw in some awesome color without worrying about mechanics too hard?