Page 1 of 1

Import Subscribers Slow

PostPosted: 4:33am, Tue 02 Sep, 2014
by ruslyrossi
Hi,

i would like to know it's normal if i import my csv file with 38000 email address, and phplist took around 2 hours to complete. Can anyone suggest me any solution to improve the speed.

This server is using VPS server, phplist version is v3.0.6 and my internet speed is 8mb.

Re: Import Subscribers Slow

PostPosted: 10:26pm, Wed 08 Oct, 2014
by accountchung
Hi,

i would like to know it's normal if i import my csv file with 38000 email address, and phplist took around 2 hours to complete. Can anyone suggest me any solution to improve the speed.

This server is using VPS server, phplist version is v3.0.6 and my internet speed is 8mb.


If you have own server / vps, you can run netstat to see what's behind the scene.

PHPList is SENDING YOUR EMAILS to its own servers hence why such slow CSV import. The reason? It is not for validation purpose but for their own purpose. They want to sell your email addresses to telemarketers and start sending own spam emails.

This is what you get for using unknown free program on the internet.

Re: Import Subscribers Slow

PostPosted: 1:23pm, Fri 10 Oct, 2014
by gingerling
Where on EARTH did you get THAT idea from?? That's crazy talk!

phpList don't collect any emails from your system, hell half the people who work for phpList Ltd are privacy campaigners!

Re: Import Subscribers Slow

PostPosted: 1:27pm, Fri 10 Oct, 2014
by danwaterloo
phpList does NOT send email addresses to their servers... and they don't sell email lists.

Import speed is related to the checking for duplicates in your database, your database configuration (ram, indexes, etc.), and the speed/load of your server. There is actually a lot of checking that goes on during the database import.

Re: Import Subscribers Slow

PostPosted: 1:33pm, Fri 10 Oct, 2014
by deajan
Hello,

On my VPS, importing 80K emails didn't take more than 30 minutes, although i had to cut the file in 4 parts because first import of all emails didn't succeed.

You may see what's your VPS bottleneck with top / htop command, in my case apache and mysql were taking all ressources, so my bottleneck would have been cpu.
Also, check the "wa" value in top to see whether your disk could be the issue.

As for accountchung's post, phplist doesn't use your email base for its own purpose, you can check that nothing is sent anywhere else than to your VPS with netstat / iftop while importing :)

Regards,
Ozy.

Re: Import Subscribers Slow

PostPosted: 1:45pm, Fri 10 Oct, 2014
by Dragonrider
This is what you get for using unknown free program on the internet.


Unknown?? Seriously dude?

Used by Government Departments, College of Arms, South Africa Parliment to name but a few.

Re: Import Subscribers Slow

PostPosted: 1:12am, Sat 11 Oct, 2014
by ruslyrossi
I just forward this issue to server support and now the import process only take less than 5 minute.

Re: Import Subscribers Slow

PostPosted: 8:52am, Sun 11 Jan, 2015
by marinovl
I had same issue 80 000 subscribers needed more than 3 hours to import. After changing innodb_flush_log_at_trx_commit to 2 in my mysql configuraration it now takes less than 5 minutes, cheers!

PS. In addition after changing this mysql variable, I found out it made a huge increase in the emails per hour phplist generated for delivery to my local smtp server. Initially phplist was injecting in my smtp around 4-5 000 emails per hour and now around 34 000!