Page 1 of 1

Importing from a v2 Database into v3

PostPosted: 3:16pm, Sun 07 Sep, 2014
by ryanrbftp
We have an active v2 mailing list system set up at present.

We have just configured a brand new v3 installation and wish to import all users from our v2 setup into our new v3 install.

We want to only import users that are confirmed and not blacklisted. I.e. users that are set to receive mailings.

Can somebody provide information on the best way to do this?

Thank you for your tips, advise and suggestions in advance.

Re: Importing from a v2 Database into v3

PostPosted: 3:16pm, Tue 09 Sep, 2014
by ryanrbftp
Does anybody have any ideas for the best way to do this?

Re: Importing from a v2 Database into v3

PostPosted: 8:07am, Wed 10 Sep, 2014
by danwaterloo
If you are 'starting over' with a clean list, two approaches come to mind:

1. Open the v2 database with v3 of phpList, and it will convert the database to the proper v3 format. Then go into the database directly, and delete the contacts that have bounced or unsubscribed. (you'll need to also go into the various user_ tables and delete the data associated with the deleted users).

2. Using a direct connection to the v2 database, determine the SQL that would export the users that have not bounced or unsubscribed. Export, then import that into the new installation (you'll probably drop the user history if you do it this way.

I'm not aware of a menu that will allow you to do this via the web interface.

Re: Importing from a v2 Database into v3

PostPosted: 11:44am, Wed 10 Sep, 2014
by ryanrbftp
Thank you for your reply Dan.

This should cover it, right? :
Code: Select all
SELECT email FROM 'phplist_user_user' where confirmed = '1' and blacklisted = '0';

Re: Importing from a v2 Database into v3

PostPosted: 1:17pm, Wed 10 Sep, 2014
by danwaterloo
That's a good start, but I've also noticed that the phplist_user_blacklist table has email addresses that you want to exclude...

So you should use your select , into a new table, then delete any addresses in the new table that are in the phplist_user_blacklist table. Then you're ready to go.

Re: Importing from a v2 Database into v3

PostPosted: 1:52pm, Wed 10 Sep, 2014
by ryanrbftp
Thanks for pointing that out Dan - we have imported all users now.

We are running into a bit of trouble with the new version.

In our v2 install, we disabled batch processing (send messages as fast as possible).

However, in v3 - we have:

Code: Select all
define("MAILQUEUE_BATCH_SIZE",0);


However, it still runs a batch job in the browser and has a limit of 10,000 messages per hour.

We are getting:
In the last 3600 seconds more emails were sent (10000) than is currently allowed per batch (10000)


However, in v2 we could process the queue and close the browser and the message would send as fast as possible.

How can I disable batch processing?

Re: Importing from a v2 Database into v3

PostPosted: 2:44pm, Wed 10 Sep, 2014
by danwaterloo
you can set the send rate to whatever you want, using the config.php file.

I put together a spreadsheet that will help you figure out the settings should be...
http://www.phplistsupport.com/config-ph ... -throttle/

To have it automatically send, you can setup a cron job to process the queue, and to process the bounces. Once that is working, you can disable the menu(s) for queue and bounce processing in the web interface...
http://docs.phplist.com/SetupCronJob.html

Re: Importing from a v2 Database into v3

PostPosted: 7:39pm, Wed 10 Sep, 2014
by ryanrbftp
Thanks for that Dan; very helpful.

Another thing we would like to be able to do is unsubscribe or remove users that have not been active members of our mailing list. I.e. users that haven't clicked on links within mailings for an X amount of email messages - inactive subscribers.

Does the link tracking feature provide this functionality? Or are there plugins to achieve this?

Re: Importing from a v2 Database into v3

PostPosted: 8:47pm, Wed 10 Sep, 2014
by danwaterloo
You should turn the linktracking on, so that the links are converted over to ones that track who clicks on what.

The 'inactive subscriber' functionality is not built in, you'll have to figure out a query to look them up, and then you can unconfirm them via another query...

Re: Importing from a v2 Database into v3

PostPosted: 12:02pm, Thu 11 Sep, 2014
by ryanrbftp
Thanks Dan. Clicktracking is now on. We will craft a SQL query once we have enough data in.

We are having another issue re. DKIM. We are signing at MTA level (not PHP) using opendkim - see my post here:
viewtopic.php?f=35&t=41606