Support

Home Forums Event Espresso Premium Split: Warnings occurred during your last migration

Split: Warnings occurred during your last migration

Posted: August 25, 2015 at 12:27 pm


bdearth

August 25, 2015 at 12:27 pm

Hi Lorenzo,

I am also in the middle of this process and receiving the same errors.

When initiating upgrade I received this message “Event Espresso has detected event data from version EE4.7.10.p (Core) that can be migrated (updated) to work with version EE4.8.0 (Core).” The migration process is also taking an extremely long time (only 17% migrated after 2 hours), which I don’t remember from previous updates. I am concerned about the error messages and the time it is taking, as we have events coming up and the site is disabled for maintenance still. Should we be stopping the process since you indicate that it will not be fixed until the next release? If so, how do we get the site back out of maintenance mode?

Thanks.


Lorenzo Orlando Caum

  • Support Staff

August 25, 2015 at 2:51 pm

Hello, this is fixed in Event Espresso 4.8.5:

https://eventespresso.com/wiki/ee4-changelog/

Could you cancel the migration and then restore from a backup and try again?


Lorenzo


bdearth

August 25, 2015 at 3:21 pm

Thanks, Lorenzo. Unfortunately, my IT support person is away so I may have to instruct another person exactly what to restore. Can you please provide me with the exact steps and files to look for? Are we stuck in limbo in the meantime? Or, can maintenance mode be turned off. I notice none of our events appear on our site if it is in Maintenance mode. Neither can I do anything else on the site?


Lorenzo Orlando Caum

  • Support Staff

August 25, 2015 at 5:49 pm

Hello again, the site enters maintenance mode when a migration process starts. However, if it did not complete then you can deactivate Event Espresso and then restore from a backup. Then upgrade to the latest version and try again.


Lorenzo


bdearth

August 26, 2015 at 9:52 am

Thanks, Lorenzo. We have restored to a backup from the previous day. When I login, I now get this message:

As part of the process for updating Event Espresso, your database also needs to be updated. Event Espresso is in COMPLETE MAINTENANCE MODE (both WordPress admin pages and front-end event registration pages are disabled) until you run the database update script. Visit the Maintenance Page to get started, it only takes a moment.

So, before I do anything, I want to be certain I don’t run into the same problem as yesterday. I went to the Maintenance Page and there is nothing that says “script”. There are 2 options — to either Migrate EE4.7.10p (Core) data to EE4.8.0 (Core); or, Just Start EE4.8.4p and delete existing data. I chose the first option yesterday because we have event registrations running and I did not want to lose that registration information. However, option one is what got me into trouble.

Are you suggesting that one of these options is the “script” you are telling me to run? And that, if I choose the first option again, it will work now?

Thanks for your help!


Lorenzo Orlando Caum

  • Support Staff

August 26, 2015 at 1:20 pm

Hi, thanks for checking. Please use the first option so your information is migrated.

If you use the second option, then its equivalent to starting brand new so go with the first option.


Lorenzo


bdearth

August 27, 2015 at 7:42 am

Hi Lorenzo,

I have restored to a previous day’s backup and run the first option (which is the one I have selected all along). I ran this migration all evening and overnight. When I arrived back into my office it had stopped running. When I restarted it, it was still only at 26% (20000 of 76000). I am at a loss as to what to do as we are in the middle of this process and yet, as we are in maintenance mode, we cannot accept registrations for any other events. I cannot imagine that this should take so long. We do not run very many events — max 30 per year. Our numbers are less than 50 per event and usually less than 25. So, what is the problem with this migration?


Lorenzo Orlando Caum

  • Support Staff

August 27, 2015 at 1:07 pm

Hi, I let one of our developers know and he would like to take a look at your site. Could you follow up with us here?

https://eventespresso.com/send-login-details/

Please go ahead and cancel the migration and then restore from a backup so that the site is functional again. We’ll share feedback once we have had a chance to take a look at the site.


Lorenzo


Michael Nelson

  • Support Staff

August 27, 2015 at 1:24 pm

thanks for the numbers there dbearth. This particular migration is updating your old order data. So if it counts there to be 76000 records to migrate, that means it counted that you have 76,000 orders in your database. If that’s right, that explains why it’s taking so long. Also, in order for the migrations to continue, your web browser must be open. So if you left your computer and it went into hibernation then the migrations would have been paused. So while running the migrations make sure your browser remains open.

Now the main question is: why are there SO many orders in your system, especially if you only have 30 events a year? I’m guessing you don’t have thousands of registrations per event right?

I’d guess some spam bots have been visiting your site and creating orders but not completing them. A few months ago we added a process that should have been cleaning out those spam bot orders but I suspect something’s prevented it from doing its job on your site. (We’ve also more recently added some bot catchers that should prevent any spam bots from registering in the future).

It would be really helpful if we could login to your site and see what’s going on, and possibly install the adminer plugin in order to look at the data under the hood.
Could you please fill out this form https://eventespresso.com/send-login-details/ and we’ll continue from there (don’t worry if you don’t know your FTP credentials, just access as a WP Admin user will be sufficient)


bdearth

August 27, 2015 at 2:08 pm

You are absolutely right. We do not have anywhere near the numbers that are showing. We ran into a similar problem with transient data back on March 3, 2015 and something to do with purging transient data. I don’t remember how this was corrected but I think I remember that our IT support folks had to be involved at some point. But I thought this was corrected with the next version of EE. I think I have a lot of spam control on the site now because we have other apps for which we need this. But, perhaps EE needs something different. These SPAM registrations must also be “hidden” because there is no overt record of them. I am going to cancel the migration, again, and have our IT folks roll back to a previous backup. Then, I have to figure out how to give you access to our site. I will use the login site you provided when I figure it out.

What is “Adminer” and why do you want me to install it? For how long? My technical expertise is very limited with any back-end applications.

Thanks.


Michael Nelson

  • Support Staff

August 27, 2015 at 2:57 pm

What is “Adminer” and why do you want me to install it? For how long?

We’d only use this plugin while investigating why you have so many order records, and why the cleanup task wasn’t getting rid of them. It’s just a convenient way for site admins to take a more direct look at the database. We can install it once you grant us access to the site, and remove it once we’re done.


bdearth

August 28, 2015 at 8:08 am

Hi Michael,

I’m not exactly certain how to create this temporary account. Do I create a temporary new user with an admin role? An email address is required for this and I don’t have one for you. If you need a different access, I would have get you to work with the ISP. Also, when I go to the “Send Login Details” page you provided, I do not see your name in the dropdown.


bdearth

August 28, 2015 at 9:55 am

Hi again, Michael,
I just had our IT folks roll back to the previous setup with EE installed before all this began. But it seems to now be stuck in maintenance mode and I can’t get out of it without doing a migration. So we still cannot see our current events and registrations and we cannot get to a stable state. Here’s our system
WordPress Version:
4.3
PHP Version:
5.3.3
MySQL Version:
5.0.95
Event Espresso Version:
4.8.6.p
WordPress Address (URL):
http://www.itc.mb.ca
Site address (URL):
http://www.itc.mb.ca


Michael Nelson

  • Support Staff

August 28, 2015 at 10:35 am

I think from your comments above, your backup was of EE4.7.10p. So when you restore to a backup, you should also have that same version of EE active, not the current version of EE. Here is an archived copy of it that you can upload to your website: https://github.com/eventespresso/event-espresso-core/archive/4.7.10.p-sans-tests-tag.zip
You can simply deactivate what you have now, EE4.8.6.p, upload this archived version to your site, EE4.7.10.p, and activate it, and your site should be taken out of maintenance mode.


bdearth

August 28, 2015 at 1:10 pm

I was able to download and copy the old version to the server, overwriting the files on the server. The site now shows that I have 4.7.10 installed, but as soon as I activate it, I am told I am still in maintenance mode with the following message:

“Event Espresso is in full maintenance mode. A previous version of Event Espresso has detected. But before anything else can happen, we need to know whether or not to migrate (copy over) your existing event data so that it can be utilized by EE4. For more instructions on what to do, please visit the Event Espresso Maintenance page.”

And so, we are back to square one. Did I do something wrong?


Michael Nelson

  • Support Staff

August 28, 2015 at 1:15 pm

bdearth if you visit the maintenance mode page, what does it say your site needs to be migrated FROM? Because I thought your database would be at version 4.7, and the EE4 plugin is at version 4.7, so it shouldn’t need to run any migrations or be in maintenance mode.
I suspect just visiting the maintenance mode page will force EE to realize it doesn’t need to be in maintenance mode because there are no migrations it can run


bdearth

August 28, 2015 at 1:28 pm

It’s telling me to migrate from EE4.7.10.p (Core) data to EE4.8.0 (Core).


bdearth

August 28, 2015 at 1:30 pm

No, I’m sorry to say, visiting maintenance mode page did not “reset” maintenance mode.


bdearth

August 28, 2015 at 1:44 pm

I just had a thought to ask our IT support to “re-restore” the files and we are successfully back at 4.7.10p. I’m still not sure how to proceed from here with the 4.8 update and migration of data… but we are at least back to a stable version.


Michael Nelson

  • Support Staff

August 28, 2015 at 1:49 pm

I think the problem was that you copied the 4.7 files into the 4.8 folder. ie, you now have EE4.7 BUT IT ALSO HAS EE4.8 files in it, which is very strange.
You’d be better to delete the EE4 files, and then re-upload the zip I linked to above how you did before. That way you will be sure to have EE4.7 with absolutely no leftover files from EE4.8


Michael Nelson

  • Support Staff

August 28, 2015 at 1:56 pm

I’m still not sure how to proceed from here with the 4.8 update and migration of data…

I think the next best step would be to remove all the transactions created by spam bots; and identify why they weren’t removed before. For that you could grant us server access, or sending us a database backup might help too


bdearth

September 2, 2015 at 6:59 am

Hi Michael/Lorenzo,
I have checked with our ISP-tech support on this transient data issue and, if you will look back in my support posts about 5 months ago, the same issue occurred and it was in the Event Espresso plugin. The time stamps for expiration were double what they should have been. So they’d expire well into the “future.” Can you please check on this and let me know what you find out. Thanks.


Michael Nelson

  • Support Staff

September 2, 2015 at 11:55 am

bdearth there seems to be confusion so I’m going to try to be clear:
I think you’re confusing “transIENT” with “transACTION”. They’re totally different. “Transients” are temporary WordPress data. “Transactions” are permanent Event Espresso registration records.
The current migration issue has nothing to do with “transients”. So the issue you’re referring to from months ago isn’t relevant.

So with that in mind, what I said last time applies:

I think the next best step would be to remove all the transactions created by spam bots; and identify why they weren’t removed before. For that you could grant us server access, or sending us a database backup might help too

If granting us server access or a database backup aren’t option let us know and we can try to coach you through the technical details


bdearth

September 2, 2015 at 12:27 pm

Michael, I apologize for my misunderstanding. I have provided you with information to login using your web utility. Please check there for credentials.
Thank you.


Michael Nelson

  • Support Staff

September 2, 2015 at 12:35 pm

no worries! There are a few terms which are confusing like that.
We’ll take a look asap


Michael Nelson

  • Support Staff

September 4, 2015 at 2:37 pm

hi bdearth, I used the login credentials provided and logged into your site.
I initially found Event Espresso was still in maintenance mode but on version 4.7.10, because that version of 4.7.10 somehow had some key files from 4.8 because of how the files were copied.
In order to take Event Espresso out of maintenance mode, I followed the steps outlined https://eventespresso.com/topic/split-warnings-occurred-during-your-last-migration/#post-170526, ie, uploaded a proper copy of 4.7.10 to your site and activated it instead. I left the other polluted version on the site too in case you may want it, but it is inactive and would suggest it.
I looked in your database and you do indeed have a lot of spam transactions in your system. Our spam cleanup is working, but it’s currently quite conservative and only deletes spam transactions after a full week of being in your system.
So when you went to migrate, you’re migrating an extra 80,000 spam transactions , which explains why its taking so long.

So the solution: add this snippet of code to your functions.php file (you may need to ask a technical person; or I can do it) to make the database cleanup more aggressive and cleanup spam transactions that are a day old:


function espresso_cleanup_junk_transactions_quicker( $time_to_leave_alone ) {
return DAY_IN_SECONDS;
}
add_filter( 'FHEE__EEM_Transaction__delete_junk_transactions__time_to_leave_alone', 'espresso_cleanup_junk_transactions_quicker' );

And wait for the cleanup task to run (or manually invoke it using a plugin like Crontrol) while Event Espresso 4.7.10 is active and running. After an hour that should have cleaned most of your spam transactions, and then the migration should go by much quicker.

I’d recommend doing this when you afterwards have some time to verify everything is still running smoothly on your site. So is now a good time to re-attempt the migration?


bdearth

September 4, 2015 at 2:46 pm

Thank you, Michael. I actually did successfully role back to the previous version and get the site out of maintenance so that the current event was able to be viewed. So, I’m not sure what happened to put it back into maintenance. Nevertheless, I understand what you are saying about the cleanup and I would like to use that code, as long as you don’t think it will break any future updates for the site. I think I know how to do this. BUT, if you would be willing to do that for me, I would appreciate it. Yes, then go ahead and run the upgrade and migration. Please notify me when this has taken place and we will test it out. Thanks so much!


Michael Nelson

  • Support Staff

September 4, 2015 at 3:09 pm

Ok I temporarily added that snippet and ran the cron task to clean up the spam transactions. It removed 70,000 spam transactions and their associated registrations and line items. When I upgraded to 4.8.7 and ran the migrations, they only took about 30 seconds to run. The site is now out of maintenance mode. You can now verify it’s running properly again. I’ve removed the adminer plugin and the version of 4.7.10.p I uploaded temporarily


bdearth

September 4, 2015 at 3:11 pm

Wow! That was quick. Thank you for sticking with us on this issue. I will test it out and let you know if there are any issues.


Tony

  • Support Staff

September 8, 2015 at 3:58 am

Hi bearth,

I just wanted to check in and see if everything is working as expected?


Lorenzo Orlando Caum

  • Support Staff

September 12, 2015 at 4:01 pm

Hello again, I wanted to share some updated information on this issue as it could be helpful to members that have not yet upgraded to a current version of Event Espresso.

In Event Espresso 4.7.x we introduced a clean up feature that runs on its own to remove these junk transactions. In Event Espresso 4.8.x, we introduced a bot trap which should minimize registration attempts from bots.

If you are using an older version of Event Espresso (e.g. Event Espresso 4.6.x) than one mentioned above, then you won’t have the combined protection of the features above. The recommended solution is to manually remove the junk transactions as described here:

https://eventespresso.com/topic/slow-data-migration-to-4-7-0/#post-172280

…and then backup your WordPress site upgrade to the current version of Event Espresso:

https://eventespresso.com/wiki/ee4-changelog/

Thanks


Lorenzo


bdearth

September 14, 2015 at 12:26 pm

Thank you, EE support staff. Everything appears to be back on track with the new event promotion.


Lorenzo Orlando Caum

  • Support Staff

September 14, 2015 at 1:33 pm

Thanks again for working with us to resolve this issue. I’ll go ahead and close this support post out.


Lorenzo

The support post ‘Split: Warnings occurred during your last migration’ is closed to new replies.

Have a question about this support post? Create a new support post in our support forums and include a link to this existing support post so we can help you.

Event Espresso