How To Read Large Files In Php. - Tutorial on reading large files in PHP.

renegade_division

Oct 4 2005, 05:30 PM

First of all don't use file() function instead use fread() functions.
I think you should deploy the split-script technique. Its different
from splitting your text file. Instead you get two scripts to do the
same job.
Or you can deploy the following method.
First of all you should be knowing the size of the max text file which
can be read in the max_execution_time on your Web Server.
For that you need to use fread() function. with something like this:

CODE

$file=fopen("file.txt","r");
$count=0;
while(!feof($file))
{
$data=fread($file,1024);
print($count+"<br>");
flush();//flush it in between
ob_flush();//so that you get the count of max number of 1024 chunks
supported
$count++;
}

Now when the script crashes note down the count number and copy the
script where you used the file() function with some other name.
For example:

CODE

//file_proc.php
if(!isset($_GET['startcount'])&&!isset($_GET['startcount']))
{
$startcount=0;
$endcount=$max_count_supported;//the number you took from the last
script.
}
$file=fopen("file.txt","r");
fseek($file,($endcount-$startcount)*1024);
for($count=0;$count<=($endcount-$startcount);$count++)
{
$data=fread($file,1024);
//Process the data here
}
//Redirect the script to file_proc.php?startcount=$endcount&endcount=($endcount+$max_supported_count)

I guess this should be getting the work done.

snlildude87

Oct 4 2005, 09:08 PM

Hmm, do you know the average maximum file size that can be read on a server?

mendezgarcia

Oct 5 2005, 12:07 AM

snlildude87: the problem is not the max file size, it's the max execution time, which is usually set to 30.

renegade_division: you can, instead of doing this, increase the max_execution_time value (PHP_INI_ALL), using for example ini_set().

http://www.php.net/ini_set
http://www.php.net/manual/en/ini.php#ini.list

snlildude87

Oct 5 2005, 12:31 AM

mendez, so will I have to do something like this:

CODE

<?php
ini_set("max_execution_time", 99);
?>

ADD REPLY / Got an Opinion!	Remove these ADs!	RAPID SEARCH!	Free Web Hosting	[X]
Express your Opinions, Thoughts or Contribute more info. to help others. Ask your Doubts & Queries to get answers, So that "Together We can help others!"	Register FREE for AD-FREE forum, Create your own topics, Ask Questions, track topics, setup subscriptions & notifications and Get a Free Website w/ Email and FTP.		500MB Space No Ads, CPanel, FTP, PHP, MySQL, EMails - 100% FREE