Quote from: PoolPlaya on June 07, 2013, 06:37 amthanks for doing this, StExo! I know full well how much work is put into projects like this, especially in the beginning stages where most of the work is manual and mind numbingly boring. But one continues to look for ways to automate tasks that take up the most time, until you got some process down that kicks ass. Sounds like you're making progress in that area already.So thanks for coming up with the idea and following thru with it. I'm sure when you grasped the enormity of the task at hand, you might have had a few second thoughts about whether it was all going to be worth it. I have found that just barreling right into it and investing blood, sweat and tears, makes it easier to make the commitment to finish it out :) Once you've got 10 hours of grunt work in, you don't want that to all go to waste. ;DI would be interested in hearing about your procedure for doing this (you can pm if you like). Maybe I can research some solutions to any issues you have, or maybe come up with something that will cut down on manual work. I have been in IT for the past few decades, and have always enjoyed finding ways to automate things... mostly in software rollouts or collecting information about pc's thru the network. Anything that involved someone manually having to perform a task over and over, I would always be trying to find a away to automate it. Work SMART, not HARD is my motto! 8)Just wanted to say thanks a lot to you, and anyone else that has worked on this. I feel it important to make sure you know that there are many of us that appreciate the time and effort that was put into something that can benefit all of us.The trick is trying to load every single page on SilkRoad without needing to manually click through them. Once you can do that it's easy because you can then just grab all the page URL's, filter them so only the ones which contain /user/ remain and then make it a mass URL download. So other minor niggles like making sure it doesn't download the "report vendors" or pages like that since it'll trigger the option but they're easy once you've got the basics hammered. The next version is downloading this very moment but it does take hours to finish.