Grabbing HTML from a page only a logged in user can access?

Question

Essentially I want to grab some data from a web page that only a logged in user can see i.e. Facebook analytics and Page insights.

If I query the specific page and try to grab it normally, it doesn't work.

Is there any way to do this?

http://stackoverflow.com/questions/10307744/how-to-login-in-with-curl-and-ssl-and-cookies — Karl, Jun 01 '15 at 23:47
Yes I have the login credentials, thanks for the link Karl, I'll have a look now. — TheDream, Jun 01 '15 at 23:50

score 1 · Answer 1 · answered Jun 01 '15 at 23:54

Use CURL and cookie session to login to the page remotely

using these options:

$url = 'https://somewhere.com';
$post['user'] = 'myuser';
$post['pass'] = 'mypass';
$ch = curl_init( );
curl_setopt($ch, CURLOPT_URL, $url );
curl_setopt($ch, CURLOPT_COOKIESESSION, true );
curl_setopt($ch, CURLOPT_COOKIEFILE, 'cookie.txt' );
curl_setopt($ch, CURLOPT_COOKIEJAR, 'cookie.txt' );
curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, false);    
curl_setopt($ch, CURLOPT_POST, count( $post ) );
curl_setopt($ch, CURLOPT_POSTFIELDS, http_build_query( $post ) );
curl_setopt($ch, CURLOPT_USERAGENT, 'Mozilla/5.0 (X11; Linux x86_64)     AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/32.0.1700.107 Chrome/32.0.1700.107 Safari/537.36');

echo $result = curl_exec($ch); // Outputs HTML response from url

*Take note that posts name vary from the site your trying to login.

Thanks, I think this was just what I was looking for! – TheDream Jun 01 '15 at 23:56 — TheDream, Jun 01 '15 at 23:56

score 0 · Answer 2 · answered Jun 01 '15 at 23:50

0

I have used this successfully.

$context = stream_context_create(array(
    'http' => array('header'  => "Authorization: Basic " . base64_encode("$username:$password"))
));
$data = file_get_contents($url, false, $context);

answered Jun 01 '15 at 23:50

Lance

3,824
4
21
29

Grabbing HTML from a page only a logged in user can access?

2 Answers2