So....
TCGPlayer has now decided to change the way they post the Price Guides and I am no longer able to scrape the website pages to get my information that I load into collection sheets. This is not so bad when it comes to gathering the set information, but now I am no longer able to update my prices to see what my collection total is.
Options now are to use a site like MTGPrices, Deckbox, or even TCGPlayer to keep track of my inventory. OR... I build my own application to scrape off data from websites to get prices and keep going with my own application. TCGPlayer will not give me their API to write my own application because I am not a company that is trying to drive traffic to their site, and MTGPrices has an API that I have a request out to in order to see if I can use theirs.
All in all, I need to start building a python script that will allow me to gather data from sites for the prices so I can then merge it with data I can gather from other sites on card information.
This is going to be a long process...
More to update later.
Subscribe to:
Post Comments (Atom)
-
So being away from writing I was not just sitting around doing nothing. I was still trading and purchasing cards, but in doing so I hit som... -
I am going to be taking a break from updating my blog until I start doing more with Magic the Gathering. I am not going to sell the collect...
-
Total Trade Count: 206,770 Total Foil Count: 3,742 I have been posting more and more into the Reddit-verse, sharing more and more of my e...
Hi, just stumbled across your site while search for someone else that had updated their spreadsheets with TCG Player price guide URL changes. I have a spreadsheet I got from somewhere (think it was off of Reddit last year) that uses queries against the TCG Price Guide pages to scrape the price data.
ReplyDeleteThe spreadsheet that I use just stopped working since TCG Player changed the URL of the price guide output. Previously it was looking at pages like "http://magic.tcgplayer.com/db/price_guide.asp?setname=Battle for Zendikar". I've updated it to do queries like "http://shop.tcgplayer.com/price-guide/magic/battle-for-zendikar" and it seems to still work OK.
The columns that previously held the prices have moved around a little (TCGMid was column 7 for me and is now column 5), so I'll have to update all of my queries in the spreadsheet, but at least it looks like it's still possible to scrape the information.
Let me know if you want a copy of the spreadsheet that I use to scrape TCG. I haven't updated all of the queries yet to match the new URLs for anything other than Oath of the Gatewatch, but it might be helpful for you.
Allen.
allen.greer@gmail.com
Hey! You are my first comment ever!
DeleteThanks for the offer, but this issue has just thrown me into having to code something that I can use forever without using Excel. I have founds some sites to gather all the card data, and I really want to get something that gathers more than just TCGPlayer prices. Once I get my hand around the solution I hope to be posting more here.
Seriously though, thank you so much for posting! It is really exciting that other MTG people are finding my pages!
Hey! You are my first comment ever!
DeleteThanks for the offer, but this issue has just thrown me into having to code something that I can use forever without using Excel. I have founds some sites to gather all the card data, and I really want to get something that gathers more than just TCGPlayer prices. Once I get my hand around the solution I hope to be posting more here.
Seriously though, thank you so much for posting! It is really exciting that other MTG people are finding my pages!
OK, good luck! I'll bookmark your blog and look for updates.
ReplyDeleteLooks like the new TCG PriceGuides aren't listing Low/Mid/Hi anymore, but rather Low, Median and TCG "Market Price". All of my apps that I use on my phone are still pulling TCG Mid which is slightly lower than the new TCG Median.
Allen.
OK, good luck! I'll bookmark your blog and look for updates.
ReplyDeleteLooks like the new TCG PriceGuides aren't listing Low/Mid/Hi anymore, but rather Low, Median and TCG "Market Price". All of my apps that I use on my phone are still pulling TCG Mid which is slightly lower than the new TCG Median.
Allen.