No, the EE3 licenses give you access to Event Espresso 4+ as the idea is that everyone will eventually move over to EE4.
If you look at your account page, in the downloads section you’ll see an EE4 section which gives you access to ee4 and add-ons. Eventually if you start using more of the EE4 add-ons and want access to those you’ll be better switching over to the EE4 Everything License.
Side note – I highly recommend you create a development copy of your current site and install EE4 there first… run through the migrations there (if you want to pull your EE3 data into EE4) and confirm everything works as it should as EE4 is very different system to EE3. Then, you can work out any issues/updates to the theme etc that need to be done and apply those to the live site before running the migrations there. In short, test the migrations and EE4 works well with your current site set up on a separate copy of your site before you run it on live, that way you’re not in a panic to try and fix any issues that come up (if any).