1. Healthpointe 2 0 Programmers

May 28, 2017  Healthpointe medical group inc. Associate Computer Programmer Pedagogue 0 2 4 6 8. Programmer Analyst at Genuine Parts Company. Chemical Engineering, 3.2 / 4.0 Experience: Fluor. April 2013 Healthpointe Medical Group. See what samuel osbourne. Just change serving sizes to suit healthpointe but a great healthy way to flavour.

I am new to Scrapy (& Python!), and I am trying to scrap the commentary from the Cricinfo website.Here is an example of a webpage:http://www.espncricinfo.com/champions-league-twenty20-2014/engine/match/763595.html?innings=1;view=commentary

• HealthPointe Medical Centre is an interdisciplinary pain institute providing assessment and rehabilitation services to clients with complex neck and back pain, soft-tissue musculoskeletal pain and other complex soft-tissue pain conditions. At HealthPointe, we strive to educate, rehabilitate and treat clients suffering from ongoing or recurrent.
• The i3 performance programmer continues our tradition of making big power and economy gains that are easy to install. The i3 lets you take control of your vehicle like never before, for any LS power plant made from 1999 or newer and any Duramax from 2001 up to 2010.

I'm interested in scraping the over numbers (0.1 for eg), and the text next to it.

Using Firebug I can see that the xpath of the '0.1' is:/html/body/div[2]/div[3]/div[4]/div[5]/div/div[3]/table/tbody/tr/td[2]/div/table/tbody/tr[2]/td[1]/p

and the text next to it is:/html/body/div[2]/div[3]/div[4]/div[5]/div/div[3]/table/tbody/tr/td[2]/div/table/tbody/tr[2]/td[2]/p Keygen simplecast 3.1.

I am trying to loop through the rows (/tr) then return td[1]/p/text and then td[2]/p/textMy items.py looks like:

Using scrapy crawl cricinfo -o items.csv -t csv it just gives me a items.csv file with no data in it at all.

Healthpointe 2 0 Programmers

Where am I going wrong? Any help would be greatly appreciated.

2 Answers

The xpath you have is not correct and, besides, is very fragile.

As far as I understand, you need the numbers in bold and the text next to them. I'd rely on the td elements with battingComms class:

Outputs on the console:

You can get the exact result from the following example.

Use the python next sibling to get the appropriate result.

The Html code is:

Spider code is:

Not the answer you're looking for? Browse other questions tagged pythonweb-scrapingscrapy or ask your own question.