I'm almost a third of the way through reimporting all the characters from the first run into the new db. At the moment I'm only sucking down and storing the raw xml from armory and haven't done any processing. While that's going on I'm desigining a new database table structure with the concept of tracking characters over time in mind.
In the meantime, does anyone have any pointers to good tutorials on XSL? Outputting raw html is kind of a pain so being able to do XSL transformations on XML output would probably make things a bit simpler.
Showing posts with label datamining. Show all posts
Showing posts with label datamining. Show all posts
Tuesday, August 7, 2007
Friday, August 3, 2007
2nd Fetch update - 416k and counting
After 3 days or so, I've fetched new data on 416,000 of the 2.5 million characters I have so I should have new data by the end of august. I need to figure out the best way to multithread this process so I can grab data faster. As a side note, the XML data for those 416,000 characters is taking up close to 4 gigs of drive space. Coming up with a more efficient storage method is next on the list.
Wednesday, August 1, 2007
Armory Miner Gets Props!
Okoloth just got a mention on WoW Insider! It's good that people are realizing the power of the Armory.
Round 2 gathering has started
After going through the first grab of 2.5M characters, I've gone back and done some refinements on data gathering and optimization. I'm currently acquiring the latest data on all the characters I've gotten before, sorted by level descending, since what we're most interested in in the short term is data on level 70s. This time I'm fetching all of the armory data and storing it instead of just the character sheet for more complex queries and comparisons. Eventually I was get things to a point where live searches can be done.
Monday, May 21, 2007
Welcome to the Build Mine!
Like the title says, welcome to the Build Mine. In this blog, I'll be talking about World of Warcraft character builds (initially talents, then getting into gear builds as well) and applying statistical information gleaned from the Armory. I'm in the process of crunching the data, and I currently have 2.0 build information for 81,000 characters of which 16,000 are level 70, and I have about 2.5 million characters to process data for once 2.1 goes live. That's for the US alone. After that I'll be analyzing the European and Asian regions.
Until the Armory came along, everyone discussed talent builds in terms of trees: 41/20/0, 31/20/10, what have you. Now with the ability to see exactly what everyone has selected, we can drill down to the individual talent level, where there is an extreme amount of diversity. For example, I did a quick comparison of the approximately 2,000 (out of 16,000) level 70 hunters in my pre-2.1 data gathering, and out of all those hunters, The most popular build is shared by 6 characters. *6*! And I know BigRedKitty will freak out when he sees that build, since it's 6th on Llew's pass at crunching his data. However, with my sample size only being 0.3% of all the character information I'll have soon, I don't expect that to be the most popular build once all the data is crunched. That crunch will probably happen this weekend, as I suspect a fair number of players will be respeccing after 2.1 goes in, which is expected for tomorrow.
Who am I? a 41/10/0 level 60 hunter with 3 level 60 and a level 64 alt. I haven't had nearly as much time to play in the past year as the year before, as my son was born just over a year ago. That has pretty much precluded me from raiding or pretty much running any instance at all. I'm not casual by any stretch of the word, but I'm far from hardcore. I'm interested in game mechanics and social design, not only in the game itself but in the choices players make with respect to the game. In the end, I want this blog (and the forthcoming website) to be a discussion area for character builds and the rationale behind them. I'm not an expert, but I want to encourage this discussion, across all aspects of the game, be it class, intended goal or anything else that comes to mind. Again, welcome to the mine. We'll be digging deep.
Until the Armory came along, everyone discussed talent builds in terms of trees: 41/20/0, 31/20/10, what have you. Now with the ability to see exactly what everyone has selected, we can drill down to the individual talent level, where there is an extreme amount of diversity. For example, I did a quick comparison of the approximately 2,000 (out of 16,000) level 70 hunters in my pre-2.1 data gathering, and out of all those hunters, The most popular build is shared by 6 characters. *6*! And I know BigRedKitty will freak out when he sees that build, since it's 6th on Llew's pass at crunching his data. However, with my sample size only being 0.3% of all the character information I'll have soon, I don't expect that to be the most popular build once all the data is crunched. That crunch will probably happen this weekend, as I suspect a fair number of players will be respeccing after 2.1 goes in, which is expected for tomorrow.
Who am I? a 41/10/0 level 60 hunter with 3 level 60 and a level 64 alt. I haven't had nearly as much time to play in the past year as the year before, as my son was born just over a year ago. That has pretty much precluded me from raiding or pretty much running any instance at all. I'm not casual by any stretch of the word, but I'm far from hardcore. I'm interested in game mechanics and social design, not only in the game itself but in the choices players make with respect to the game. In the end, I want this blog (and the forthcoming website) to be a discussion area for character builds and the rationale behind them. I'm not an expert, but I want to encourage this discussion, across all aspects of the game, be it class, intended goal or anything else that comes to mind. Again, welcome to the mine. We'll be digging deep.
Subscribe to:
Posts (Atom)
