Projects tagged ‘curl’, ‘http’, and ‘php’

What for?To be able to get web pages content with PHP easily FeaturesVery simple HTTP Headers/cookies/body retrieving Session browsing Regular expression matches (PCRE syntax) Different encodings ... [More] support Binary data retrieving RequirementsPHP 5.x cURL PHP extension Computer Quick startDownload latest stable version Unpack (tar -xvf phrowser.tar.gz) Run examples from CLI: cd examples php example.google.phpWrite your own script: url_get('http://google.com/'); # Match google's page title echo $b->find_scalar_match('/(.*?)<\/title>/i');You should see "Google" after running that script DocumentationApiManual [Less]

I needed a litte tool that checks HTTP URLs for a defined string on a regular base. If an error occurs, predefined persons will be notified by email. Since nothing like that existed I hacked it on ... [More] my own. Furthermore I just added Twitter support which means you now can have your servers monitored via Twitter! The code is quite old so please don't bug me for the bad progamming style. It can surely be improved and that's why I publish it here :-) I also recently added Jabber/XMPP support which means that you can be notified at your jabber account. Just set up an own account for curl-probe, configure it in config.local.inc.php and add this account to your roster. After entering your account in the user profile section you are going to receive every notification via Jabber. Find more here (german only): http://nodomain.cc/2009/04/01/curl-probe.html [Less]

A more efficient implementation of curl_multi() curl_multi is a great way to process multiple HTTP requests in parallel in PHP. curl_multi is particularly handy when working with large data sets (like ... [More] fetching thousands of RSS feeds at one time). Unfortunately there is very little documentation on the best way to implement curl_multi. As a result, most of the examples around the web are either inefficient or fail entirely when asked to handle more than a few hundred requests. The problem is that most implementations of curl_multi wait for each set of requests to complete before processing them. If there are too many requests to process at once, they usually get broken into groups that are then processed one at a time. The problem with this is that each group has to wait for the slowest request to download. In a group of 100 requests, all it takes is one slow one to delay the processing of 99 others. The larger the number of requests you are dealing with, the more noticeable this latency becomes. The solution is to process each request as soon as it completes. This eliminates the wasted CPU cycles from busy waiting. I also created a queue of cURL requests to allow for maximum throughput. Each time a request is completed, I add a new one from the queue. By dynamically adding and removing links, we keep a constant number of links downloading at all times. This gives us a way to throttle the amount of simultaneous requests we are sending. The result is a faster and more efficient way of processing large quantities of cURL requests in parallel. [Less]

RequestCore is a lightweight cURL-based HTTP request/response class that leverages MultiCurl for parallel requests. RequestCore was born out of the Tarzan project, and was designed from the start ... [More] to be a reliable standalone component to be re-used in any other project. [Less]