how to import more than 10 000 emails in one go

Solutions for other phpList version 2 users
Forum rules
Please do not ask questions here, this is for Solutions you have discovered or come across.

Re: how to import more than 10 000 emails in one go

Postby moinhaidar » 6:42am, Fri 07 May, 2010

its seems we can get into that...
having previous changes intact I tweaked admin/import1.php

Code: Select all
line 45 : if (filesize($_FILES["import_file"]['tmp_name']) > 3000000)


increased filesize to 3000000 from 1000000 and RAM from 256MB to 1GB
tested 120000 emails in one go. its doing good. still need to retweak the changes for any redundancy.

Moin
moinhaidar
phpList newbie
 
Posts: 3
Joined: 5:58am, Wed 05 May, 2010

Re: how to import more than 10 000 emails in one go

Postby BrianFFM » 11:05pm, Thu 18 Nov, 2010

Hello All,

I add the hack and I see now in admin/?page=import2 a possible feld to choice the file .. I have add a file in admin/csv but the feld is emty. The hack cannot found the file. mybe possible I test it in a xampp installation on my win wks ??
BrianFFM
phpLister
 
Posts: 11
Joined: 3:49pm, Mon 05 Jul, 2004

Re: how to import more than 10 000 emails in one go

Postby BrianFFM » 11:37pm, Thu 18 Nov, 2010

ohh, I try again on my webserver. but the site is emty .. only



phplist - import emails
good afternoon admin
logout

Here you can add multiple emails to your lists. Attributes need to be identified on the first line in the file. They will be created as textline attributes if they don't exist.

CUT!
:(
BrianFFM
phpLister
 
Posts: 11
Joined: 3:49pm, Mon 05 Jul, 2004

Re: how to import more than 10 000 emails in one go

Postby Picky » 10:18am, Thu 16 Dec, 2010

Hey! I also changed my file admin/import1.php from 1MB to 5MB and that did the trick for me. I had absolutelly no problems what so ever. if you don't do that you'll crash.
Picky
phpList newbie
 
Posts: 3
Joined: 10:01am, Thu 16 Dec, 2010

Re: how to import more than 10 000 emails in one go

Postby mydemons » 1:58pm, Fri 15 Jul, 2011

Hey, nigelduck
you're my new hero. that code worked like a charm!!!!!!
if (filesize($_FILES["import_file"]['tmp_name']) > 1000000) { /* Change 1000000 */

i put this: if (filesize($_FILES["import_file"]['tmp_name']) > 50000000)

you saved me about a week's work with this!!!!
i'm ulpoading about 50.000 each time... jesus.... amazing!
mydemons
phpList newbie
 
Posts: 1
Joined: 1:55pm, Fri 15 Jul, 2011

Re: how to import more than 10 000 emails in one go

Postby sspitfire » 11:37am, Wed 05 Oct, 2011

Changing those values worked for me. Note: If you change them and then you go to manage users>import users>import uses with diff. values it still says Filesize limit is 1MB but you can actually import bigger files. Just the warning stays "phplist will not process files larger than 1Mb" this is what confused me. When I tried a 2MB file it worked.
sspitfire
phpLister
 
Posts: 9
Joined: 4:12pm, Sat 22 Jan, 2011

Re: how to import more than 10 000 emails in one go

Postby CS2 » 3:16pm, Wed 05 Oct, 2011

Pro tip - Updating this line in import1.php:
Code: Select all
      if ($done % 50 ==0) {


To something more like:
Code: Select all
      if ($done % 5000 ==0) {


Will make importing much less annoying.
CS2
PL Master
 
Posts: 216
Joined: 2:20am, Wed 04 Feb, 2009

Re: how to import more than 10 000 emails in one go

Postby favhot » 10:04pm, Tue 16 Oct, 2012

I need to build a "List" and don't know how. I have the e-mails in Word format line by line. How can I import or Copy & Paste?
Thanks,
favhot
phpLister
 
Posts: 9
Joined: 11:40am, Mon 15 Oct, 2012

Re: how to import more than 10 000 emails in one go

Postby michael21 » 9:24pm, Tue 30 Oct, 2012

Hi there,

I tried the diferent solutions but didn´t work. Could it be the version of PHP List? Any other solution?
michael21
phpList newbie
 
Posts: 1
Joined: 9:21pm, Tue 30 Oct, 2012

Re: [HOWTO] import csv from server

Postby Res55 » 7:52pm, Thu 13 Dec, 2012

pro2sell wrote:hi,
are you sick of uploading your csv one by one?
i was ;-)
so here's how you can import your lists from a directory on your server: ...


Thank you very much Pro2sell!

with your changes I am finally able to import my 100000+ emails in one import.

BTW: they hang once, because I had special characters in the email-field. And as I did not suspect them being there (as such is invalid), I did not export them in UTF-8 format but did not care about the window-proprietary-format of excel or ms-access. I worked hard for a day to find the fault.

Now I use this function in MS-access to filter out the invalid emails to avoid these hanging of phplist:
http://www.awerner.homeip.net/doku.php? ... berpruefen

It seems that phplist does not catch such faults.
all the best!

Res
Res55
phpList newbie
 
Posts: 1
Joined: 8:03am, Sat 11 Aug, 2012

Re: how to import more than 10 000 emails in one go

Postby gimp » 3:33pm, Fri 23 May, 2014

I know that this is an old thread, but here I am anyway :)

Modding this code will work, but this setting is set in /admin/init.php. Just change the import size setting and you're good. It defaults to 5. I upped mine to 50 so I can get a large list imported at once.
gimp
phpList newbie
 
Posts: 1
Joined: 3:29pm, Fri 23 May, 2014

Re: how to import more than 10 000 emails in one go

Postby mrmckoy » 7:05pm, Sun 22 Feb, 2015

How do we increase the max file import size in version 3.0.12? Has anyone done this?
mrmckoy
PL Master
 
Posts: 169
Joined: 7:10am, Sat 24 Nov, 2007
Location: Atlanta, GA

Re: how to import more than 10 000 emails in one go

Postby folst02 » 9:23pm, Sun 19 Apr, 2015

I created a .htaccess file in my webroot directory, "public_html" and placed the following

php_value post_max_size 10M
php_value upload_max_filesize 10M

I was able to import 100,000 emails in a 4 mb file with no issues and no other changes.


phplist, version 3.0.12
PHP Version 5.3.29
folst02
phpList newbie
 
Posts: 1
Joined: 9:09pm, Sun 19 Apr, 2015
Location: NY, United States

Re: how to import more than 10 000 emails in one go

Postby Dragonrider » 7:48am, Mon 20 Apr, 2015

folst02 wrote:I created a .htaccess file in my webroot directory, "public_html" and placed the following

php_value post_max_size 10M
php_value upload_max_filesize 10M

I was able to import 100,000 emails in a 4 mb file with no issues and no other changes.


phplist, version 3.0.12
PHP Version 5.3.29

Most servers do not allow php_flag values in the .htaccess files, if you need to use these values, place then inside a php.ini file instead.

The format for a php.ini file can be found here at php.net
My sites:- http://wharfedalefestival.co.uk, http://ilkleygardeners.org.uk, http://emergencyaid.net, http://dragonrider.co.uk
Latest phpList version is now 3.0.12 (3 February 2015) and requires a minimum of MySQL 5.0 and PHP 5.3.x
Dragonrider
Moderator
 
Posts: 3460
Joined: 6:58am, Sun 02 Jul, 2006
Location: Ilkley, West Yorkshire, United Kingdom

Previous

Return to Answers, Howtos, Tips & Tricks

Who is online

Users browsing this forum: No registered users and 2 guests