How to get webcontent that is loaded by JavaScript using cURL?

Question

I am trying to grab the score table from a website. The problem is that the site is using javascript that apparently loads on document.ready.

For that reason I don't seem to succeed getting the table and all I get is the buttons at the top of that page.

Any suggestions or ideas on how to solve this?

Answer 1

cURL will only get you the markup of the page. It won't load any additional resources or process the page. You probably want to look at something like PhantomJS for this. PhantomJS is a headless WebKit browser. It has its own API that lets you "script" behavior. So you can tell PhantomJS to load the page and dump out the data you need.