What happens to my clients if I cancel Agency or downgrade off it?

You keep Agency until the end of your billing period. On that day your clients are released and can continue with videoreview on their own, and logins on your agency account beyond your new plan's limit lose access. Your own agency account stays.