There is a diligence requirement in defense of a patent. You limit your possible recovery by waiting after you "know" that infringement is occuring. But you can wait until they have committed to a large production run then start the suit.
Defence is most important in the major market that you have defined as your territory It reduces in import as the target market shrinks but you must defend as much as possible if you intend to market your intelectual property.
Terry