The weapons should remain as loot on adventures.
Even when building them, the production times is long and inadequate to meet the requirements when building an army.
Upgrading buildings at higher levels require items you don't produce on the island (granite, etc)
Even then the quantity produced fails to sate the need.
Hence, my vote is to keep weapons as part of the adventure loot.