Pea gravel and pebbles can weigh down windowboxes. Empty water bottles are a lightweight option. Place rinsed bottles inside the planter and add soil on top of them. The space between the bottles will allow proper drainage without the extra weight.
Front window and outside bathroom window Arbor Originals Decorative architectural arbors and brackets instead of window boxes? Maybe just a shallow pan so the wood doesn't look dirty? What about the hurricane shutters though?