Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Yes, the other libraries are probably doing the exact same job as we do here. The problem with other libraries (that I've found) is amongst others that they are way too big. This library is asked to do one thing, so instead of including one big package of library-files, this library shoud probably be considered a light weight curl-handler. The only job this library actually does is raising the verbosity, so all URL-calls may collect as much information as possible. It also do some parsing, so configuration or data extraction has to be done manually. You could of course use other libraries aswell, but our goal is to keep this one as small as possible, just to be able to fit anywhere you'd like. The whole idea with this curl bridge is to avoid fiddling with all curl settings by yourself.

History

People sometimes wonder why we are (probably) rebuilding the wheel as others have done this too before, but this library are born from a very old project, that was built for testing proxies scraped from different kind of sites and lists. The first step that was made then, was to build a client that actually could scrape sites without having to set up a whole bunch of scripts and libraries (this happened around 2000-2006 so, in that moment, we did know very little about which libraries that existed). As the source code probably reveals it has a quite big section, just to configure tunnels and proxies in different methods. And this is also why this library exists.

...