No — if you don’t use your 4 free lounge passes annually, these will expire on the renewal date and 4 new ones will be credited to your account. You can’t have more than 4 free lounge passes available to use.
More information on the airport lounge passes can be found on the Priority Pass website.