I had a meeting with Dr. Trudel, Dr. Benoit and all of the students working on the Web Census yesterday. We all talked about what we had done over the past week, unfortunately I had nothing to contribute.
This semester I am concentrating on my classes as opposed to research. Dr. Benoit mentioned that he would forward me a list of research topics related to the Web Census, which I thought was a good idea.
Unfinished Work:
- Choose a topic for my research
Joseph O'Neill
Ideas:
ReplyDelete- visit all of the IP addresses with servers and download one (or all) of the pictures on the site. We can do some data analysis of the pics, or we could resize the pics to all the same and make a real "picture" of what the web looks like.
- Continuous census: Use the most recent web census db as a starting point. Have one machine running 7/24 randomly visit IP addresses and update the web census db accordingly.
- Google accuracy: run all the home pages in the web census db through google...how many servers has google missed?
- Census accuracy: Use a commercial anonymizer product to randomly visit IP addresses. This will allow us to visit networks that we’ve been blocked out of by system admins. When a web server is found that is not in the web census db, visit other IP addresses in the same network. Goal is to measure the accuracy of our census.
- NA location: pinpoint the geographic location of every web server in North America.